Few questions about smicha's watercooled 7 gpu build

Generic forum to discuss Octane Render, post ideas and suggest improvements.
Forum rules
Please add your OS and Hardware Configuration in your signature, it makes it easier for us to help you analyze problems. Example: Win 7 64 | Geforce GTX680 | i7 3770 | 16GB
jeunack
Licensed Customer
Posts: 18
Joined: Wed Mar 30, 2016 8:11 am

smicha wrote:Thank you all for all help to the build.

Some notes:

1. Even a 28 laned cpu is fine with dual PLX mobo for 7 gpus
2. The only drawback of i7 mobo as asus is lack of asus support for custom bios with 4G enabled that is why I go with dual xeon and Asrock/Supermicro.
3. Dual xeon give 80 lanes so there is no risk of PLX failure.
4. Aquacomputer single brackets are fine - I am waiting also for their delivery :)

Going back to unpack fresh delivery with tons of watercooling stuff - stay tuned :)
Thx I'll follow your advise ;)

For the GPU, you have sometimes 150 euros difference between two 1080ti depending on the constructor.
Is it matter for octane performance ? Do you have the same OC possibilities when they are all watercooled ?
ASRock Rack EP2C612 WS / 2 Xeon E5-2603 V3 / 7 1080ti FE / 32 Gb RAM / Win10 64bits / C4D user
User avatar
itou31
Licensed Customer
Posts: 377
Joined: Tue Jan 22, 2013 8:43 am

Hi,
Here are some update of my 7GPU rig based on same motherboard.

Rendering preview (sorry in keyshot)
7GPUrig1.jpg
7GPUrig2.jpg
And mounting 7GPUs block and box
res-DSC04710_res1.jpg
pc_xeon_cube_14-05-2017_04.jpg
pc_xeon_cube_14-05-2017_03.jpg
I7-3930K 64Go RAM Win8.1pro , main 3 titans + 780Ti
Xeon 2696V3 64Go RAM Win8.1/win10/win7, 2x 1080Ti + 3x 980Ti + 2x Titan Black
User avatar
itou31
Licensed Customer
Posts: 377
Joined: Tue Jan 22, 2013 8:43 am

Final rig,
Tested and running OK.
Thanks to Smicha and Tom for advices.
res-DSC02959_res1.jpg
I7-3930K 64Go RAM Win8.1pro , main 3 titans + 780Ti
Xeon 2696V3 64Go RAM Win8.1/win10/win7, 2x 1080Ti + 3x 980Ti + 2x Titan Black
User avatar
glimpse
Licensed Customer
Posts: 3740
Joined: Wed Jan 26, 2011 2:17 pm
Contact:

Nice! What temps You're getting, Itou31?

so "7 is new 4"? =)

I mean before quad GPU was the best & now hepta builds seems to be the way to go!
User avatar
rappet
Licensed Customer
Posts: 1962
Joined: Fri Apr 06, 2012 3:57 pm
Location: The Netherlands
Contact:

Wow... Fantastique.
That is a compact build... a Bulldog of a pc!. Enjoy.

4090+3089ti & Quad 1080ti
ArchiCAD25, ofcourse Octane & OR-ArchiCAD plugin (love it)
http://www.tapperworks.com
http://www.facebook.com/pages/TAPPERWOR ... 9851341126
http://www.youtube.com/user/Tapperworks/videos
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

Very nice itou!

After one of my 7x gpu build I definitely recommend one more thing - due to super heavy weight of gpus - at least 5+ kg for waterblocks only horizontal mobo layout is very highly recommended for transportation. Moreover almost all available cases are made of thin 1mm steel and any shock to a case will bent backside where IO brackets are mounted.

Here is my sketch of upcoming this week 11 gpus in 3mm alloy case.
Attachments
IO-12.jpg
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
User avatar
glimpse
Licensed Customer
Posts: 3740
Joined: Wed Jan 26, 2011 2:17 pm
Contact:

Vertical layout might be less of an issue if You use reinforced PCIe slots, but for shipping laying motherboard flatly is a must.

I've been shocked how much 4x Single slot modded GPUs weight - 7 of them is way too much to handle for fragile motherboard & crappy case (that were never designed for such use in the first place).
User avatar
itou31
Licensed Customer
Posts: 377
Joined: Tue Jan 22, 2013 8:43 am

Yes, the weight of these 7 GPUs reminded me to make the reinforcemment under the hepta terminal (place to locate the octane logo).
So temperature is better than my 4GPUs build. With ambiant temperature at 22°C, the max reached at an octanebench is about 47°C on the hottest GPU. In rendering daily task (PT kernel), up to 50°C, but ambiant is hotter too.

here is my old "4" beside my new "7"
res-DSC02963_res1.jpg
I7-3930K 64Go RAM Win8.1pro , main 3 titans + 780Ti
Xeon 2696V3 64Go RAM Win8.1/win10/win7, 2x 1080Ti + 3x 980Ti + 2x Titan Black
jeunack
Licensed Customer
Posts: 18
Joined: Wed Mar 30, 2016 8:11 am

Really Nice Job itou31 !
7 gpus would be very confortable with Octane 8-)
I ordered my pieces for my build, can't wait ;)
ASRock Rack EP2C612 WS / 2 Xeon E5-2603 V3 / 7 1080ti FE / 32 Gb RAM / Win10 64bits / C4D user
User avatar
itou31
Licensed Customer
Posts: 377
Joined: Tue Jan 22, 2013 8:43 am

Did you go dual CPU or single ?
I7-3930K 64Go RAM Win8.1pro , main 3 titans + 780Ti
Xeon 2696V3 64Go RAM Win8.1/win10/win7, 2x 1080Ti + 3x 980Ti + 2x Titan Black
Post Reply

Return to “General Discussion”