Best Practices For Building A Multiple GPU System

Discuss anything you like on this forum.
Post Reply
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

FrankPooleFloating wrote:So I am quite intrigued by the Noiseblocker NB-eLoop Series B12-PS Black Edition, for slapping on my Hybrids (and maybe everywhere else, except front 200mm) when I do the X9... smicha buddy, have you tried these pups yet? If not, anyone else have these (preferably on some rads)? They at least have the appearance of being something pretty damn special. Perhaps even way better than Noiseblocker BlackSilent Pro or Noctua NF-F12...

http://www.blacknoise.com/site/en/produ ... hp?lang=EN

Also, could I hook these right to the fan cable coming off 980Ti Hybrid, or do I need to use some kind of adapter or something? (NB is 4-pin PWM and 980Ti is 3-pin, right?)... I will definitely ultimately get everything on a fan controller, but not right away, unless I absolutely have to.
Frank,

Yes - you need to have a fan controller to control them on hybrids unless you use 4pin PWM connectors on your motherboard (and the fans you want to go with are PWM). I used Lamptron FC6 with 4 channels, each 20W - then a regular 3 pin fan is enough for manual speed control.

As for fans: I had for tests all NB fans ... and all are great. I always go with PL2 for my builds (simplicity, great mounting sets and price point). For hybrids though get something that spins faster, i.e., 1800 RPM. M12-3, B12-3. I think I like NB-Multiframe-Series more than eLoop (from very close distance I can hear delicate "tick" sound on eLoop). Noise performance is perfect in both. Multiframe have rubber corners. I know Tom Glimps uses them as his favorite.
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
Top
User avatar
FrankPooleFloating
Licensed Customer
Posts: 1669
Joined: Thu Nov 29, 2012 3:48 pm

Excellent. Thanks Seb. :D
Win10Pro || GA-X99-SOC-Champion || i7 5820k w/ H60 || 32GB DDR4 || 3x EVGA RTX 2070 Super Hybrid || EVGA Supernova G2 1300W || Tt Core X9 || LightWave Plug (v4 for old gigs) || Blender E-Cycles
Top
User avatar
Notiusweb
Licensed Customer
Posts: 1285
Joined: Mon Nov 10, 2014 4:51 am

Frank, are you in process of building a 12 Pascal Titan Xp?
Loco! :o
Win 10 Pro 64, Xeon E5-2687W v2 (8x 3.40GHz), G.Skill 64 GB DDR3-2400, ASRock X79 Extreme 11
Mobo: 1 Titan RTX, 1 Titan Xp
External: 6 Titan X Pascal, 2 GTX Titan X
Plugs: Enterprise
Top
User avatar
FrankPooleFloating
Licensed Customer
Posts: 1669
Joined: Thu Nov 29, 2012 3:48 pm

Nope. Just X9 case and two more 980Ti Hybrids... that still qualifies as a multi-gpu system, right?... ;)
Win10Pro || GA-X99-SOC-Champion || i7 5820k w/ H60 || 32GB DDR4 || 3x EVGA RTX 2070 Super Hybrid || EVGA Supernova G2 1300W || Tt Core X9 || LightWave Plug (v4 for old gigs) || Blender E-Cycles
Top
User avatar
FrankPooleFloating
Licensed Customer
Posts: 1669
Joined: Thu Nov 29, 2012 3:48 pm

This X9 is such a massive, humongous, enormous bastard of a case! I had seen lots of images of this dang thing, but until it arrives and you have it in front of you, you just can't know how ridiculously huge this mofo is (my NZXT H630 was pretty big, as was my Lian Li before that). It truly is the size of a mini-fridge.. hell, bigger. And when you take out drive bays (when you're all SSDs), it becomes comical how effing cavernous and mostly empty it is inside... I would still recommend X9 to anyone doing multiple hybrids and want tons of extra space to move around in. And at $150 or so, I don't think it can be beat. I actually used the two NZXT 200mm fans I had (up front), because they seemed much better quality than the one that came with X9. They're practically silent. But I think I'll need to make a custom bracket to hold my SSDs... Trying to get them into the bottom drive bays and plugged in was a nightmare, so I temporally have them laying loose in bottom of case...

So now I just need to get a couple more 980Ti Hybrids, as more get tossed on eBay after xmas... I think that when I put in the 4th GPU, I will need to get some 90° adapters or something for my front USB3 and case headers (is that what they are called? -- PWR, HD LED, Reset, etc), because it really seems like there is no way I could have those plugged in and have 4th GPU... Anyone else ever have this problem? I haven't done any searching yet because time is limited, but it would be nice to know there is all kinds of adapters etc to get out of this jam with 4th GPU...
Win10Pro || GA-X99-SOC-Champion || i7 5820k w/ H60 || 32GB DDR4 || 3x EVGA RTX 2070 Super Hybrid || EVGA Supernova G2 1300W || Tt Core X9 || LightWave Plug (v4 for old gigs) || Blender E-Cycles
Top
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

FrankPooleFloating wrote:This X9 is such a massive, humongous, enormous bastard of a case! I had seen lots of images of this dang thing, but until it arrives and you have it in front of you, you just can't know how ridiculously huge this mofo is (my NZXT H630 was pretty big, as was my Lian Li before that). It truly is the size of a mini-fridge.. hell, bigger. And when you take out drive bays (when you're all SSDs), it becomes comical how effing cavernous and mostly empty it is inside... I would still recommend X9 to anyone doing multiple hybrids and want tons of extra space to move around in. And at $150 or so, I don't think it can be beat. I actually used the two NZXT 200mm fans I had (up front), because they seemed much better quality than the one that came with X9. They're practically silent. But I think I'll need to make a custom bracket to hold my SSDs... Trying to get them into the bottom drive bays and plugged in was a nightmare, so I temporally have them laying loose in bottom of case...

So now I just need to get a couple more 980Ti Hybrids, as more get tossed on eBay after xmas... I think that when I put in the 4th GPU, I will need to get some 90° adapters or something for my front USB3 and case headers (is that what they are called? -- PWR, HD LED, Reset, etc), because it really seems like there is no way I could have those plugged in and have 4th GPU... Anyone else ever have this problem? I haven't done any searching yet because time is limited, but it would be nice to know there is all kinds of adapters etc to get out of this jam with 4th GPU...
I agree Frank - at this price point it is really hard to beat. It has some flaws for my purposes (hard access to gpus when rads are on its top, rather thin material transferring pumps vibrations, lack of good 5.25 mounts) - that is why I started producing my own case for better rad location and ease of access to a water-cooling stuff... and 11 GPUs.

If you need to place these case power cables - please take a look at the screenshot - simply bend their pins slightly and then push in a 4th gpu down. I used only power led, and reset sw. if you need it.
You do not have the required permissions to view the files attached to this post.
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
Top
User avatar
FrankPooleFloating
Licensed Customer
Posts: 1669
Joined: Thu Nov 29, 2012 3:48 pm

Hmm.. smicha buddy, did you Dremel® the front wall off in front of those pins?.. My pins are completely surrounded by four walls... And bending mine do not seem as doable on my mobo as yours...

I found this for the front USB3: https://www.moddiy.com/products/90-Degr ... ector.html
Edit: can't use this, because there is not enough room between edge of mobo and side panel plexi, if you can believe that! Fuuuuuuuudge! Guess I do not need front USB3. Have four in back.

But dang it I can't find anything similar for front panel connections. Have you ever seen any? Sure would make this a no-brainer...
Win10Pro || GA-X99-SOC-Champion || i7 5820k w/ H60 || 32GB DDR4 || 3x EVGA RTX 2070 Super Hybrid || EVGA Supernova G2 1300W || Tt Core X9 || LightWave Plug (v4 for old gigs) || Blender E-Cycles
Top
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

On the Mobo I cut the front surrounding plastic with a sharp knife.
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
Top
User avatar
Notiusweb
Licensed Customer
Posts: 1285
Joined: Mon Nov 10, 2014 4:51 am

Here is the fastest GPU average speed (I took highest listed score entry divided by # GPU)

Titan Xp ---- 219
Titan X Pascal ---- 214
1080Ti ---- 202
Titan X ---- 128

It really just confirms what we already summized, 108Ti is the best value proposition for multi GPU right now. And Just 1 VRAM GB less than the 12.
13 x 1080 T1 @ $850 = $11,050
13 x Titan X Pascal @ $1,400 (?) = $18,200
13 x Titan Xp @ $1,600 = $20,800

My prices are conservative-best middle prices....I mean, these cards as NEW are all over the place as far as pricing goes!
Win 10 Pro 64, Xeon E5-2687W v2 (8x 3.40GHz), G.Skill 64 GB DDR3-2400, ASRock X79 Extreme 11
Mobo: 1 Titan RTX, 1 Titan Xp
External: 6 Titan X Pascal, 2 GTX Titan X
Plugs: Enterprise
Top
User avatar
Notiusweb
Licensed Customer
Posts: 1285
Joined: Mon Nov 10, 2014 4:51 am

Titan V - $3,000

Specs

Graphics Processing Clusters - 6
Streaming Multiprocessors - 80
CUDA Cores (single precision) - 5120
Texture Units - 320
MHzBase Clock (MHz) - 1200
MHzBoost Clock (MHz) - 1455
MHzMemory Clock - 850
Memory Data Rate - 1.7 GBps
L2 Cache Size - 4608 K
Total Video Memory - 12288 MB HBM2
Memory Interface - 3072-bit
Total Memory Bandwidth - 652.8 GB/s

The 1st Volta - 13 * $3K = $39K :cry:
Win 10 Pro 64, Xeon E5-2687W v2 (8x 3.40GHz), G.Skill 64 GB DDR3-2400, ASRock X79 Extreme 11
Mobo: 1 Titan RTX, 1 Titan Xp
External: 6 Titan X Pascal, 2 GTX Titan X
Plugs: Enterprise
Top
Post Reply

Return to “Off Topic Forum”