What´s the best method/pc to use 12 gpus?

3D Studio Max Plugin (Export Script Plugins developed by [gk] and KilaD; Integrated Plugin developed by Karba)
Forum rules
Please post only in English in this subforum. For alternate language discussion please go here http://render.otoy.com/forum/viewforum.php?f=18
Post Reply
thilima
Licensed Customer
Posts: 29
Joined: Thu Sep 05, 2013 12:48 pm

I was taking a look at octanebench stats and I could see a lot of guys with 8, 9, 12 gpu benchmarks, I´m planning to buy 12titanX or 12x980ti i didn´t decided yet, so there is a question: How is the best way to use 12gpus?

1 - A lot of pcs with 4 gpus each?
2 - xpander like this one: http://www.cubix.com/catalog/xpander-desktop-series-ii ??? (was the only xpander company I found)
3 - Any other idea? a cheaper one maybe?

Thanks for your time
Thiago Lima
User avatar
Goldisart
Licensed Customer
Posts: 780
Joined: Sat Oct 26, 2013 8:47 am

viewtopic.php?f=9&t=42540&start=20 - 3$ + 3 PCI -express = 10$


download/file.php?id=36759&mode=view

download/file.php?id=36760&t=1

it all depends on the motherboard .. how much is it supported video cards at the same time. + DR render - the most budget option works for me for 2 years ... no problems
User avatar
glimpse
Licensed Customer
Posts: 3740
Joined: Wed Jan 26, 2011 2:17 pm
Contact:

Honestly, I would advice against going 12 GPU rig for one simple reason:
if it fails You're out of game with 12GPUs sitting still. Pluss it's expensive.
(& not to mention all the problems seeing all those cards..)

if You're into this route for around 12 GPUs, I'd rather build two rigs: 6GPUs each & then conect them using at least gigabit network..or even some faster solution (if money allow).

500$ CPU (6core, 40 lanes) + 500$ Mobo (with pair of PLX) will aalow You to hook those 6 GPUs on x8 each & thus giving least amount of bottlenecks if You choose to use any of those rigs as main workstation (look at this as having a backup system in case something bad would happen =)

to put 6GPUs (using 12 slot as each card is dual slot unit) into one motherboard, that ussually have only 8 slots in PCIe region You would have two options:

a. using ribon cables & ofsetting on custom frame..
..or..
b. singleSlot mod GPUs using waterblocks & cuting part of rear i/o - this would allow to put them directly into motherboard avoiding extra element between CPU & GPU (saving a bit of a headache on the long run).
(You can also try to get single slot GPUs like EVGA k|ngp|n 980Tis, but they fly in limmited quantities, by paying slightly more You would still have warranty, after converting into watercooled option, as You would not need to modfy rear i/o)

Watercooling has another benefits as well: firstly lower GPU temps under load (40-50C instad of 80C+), lower noice..& faster operation (in case of gm200 based cards like TitanX or 980Ti You can expect 150 isntead of 120 in terms of OctaneBench).
User avatar
Goldisart
Licensed Customer
Posts: 780
Joined: Sat Oct 26, 2013 8:47 am

http://www.regard.ru/catalog/tovar19356 ... 1473135001

the next collection will be taking out these cards. they come ready for water cooling
User avatar
glimpse
Licensed Customer
Posts: 3740
Joined: Wed Jan 26, 2011 2:17 pm
Contact:

Goldisart wrote:http://www.regard.ru/catalog/tovar193567.htm?ymclid=46123436923601473135001

the next collection will be taking out these cards. they come ready for water cooling
Poseidon are awesome, but pricy..

at ~850Eu per GPU it is 150-200Eu more expansive than cheapest 980Ti. water block for those are around 100Eu, so from each card (if You choose let's say basic route + EK backplate) You save 50-100Eu. if You would go 4-8cards with what You save You can build the rest of Your loop (rads + pump/res combos).

so, yeah it's unique card & it makes sense, bot not for water-cooling Guys guys that have multiple of those..- still use 2slot & that non reference cooler is not recommended running on air in multiGPU configuration where cards sits very close to each other (it's not my idea, but words form ASUS representatives).
thilima
Licensed Customer
Posts: 29
Joined: Thu Sep 05, 2013 12:48 pm

Thanks a lot for the answer guys, were very helpfull.
I´ll think about all suggestins you gave me. When I decide I´ll post here some images of my new machine.

:)
User avatar
Goldisart
Licensed Customer
Posts: 780
Joined: Sat Oct 26, 2013 8:47 am

but I'm waiting for support Radeon - maybe the guys from Octane render can get people to visualize graphics card ATI radeon

....
although I think miracle will not be - they will be much slower than NVIDEO ..... I would like somewhere to read about it.... if so then this year I will be purchasing 980TI ... Guys if you have information on this voprosu please leave comments
3dgeeks
Licensed Customer
Posts: 193
Joined: Wed Jun 11, 2014 8:12 am

We are using a 4 x Cubix expander, and though it works pretty good, the main Workstation it is hooked up to seems to only be able to run 1 other card. We are trying to upgrade our power supply to see if that helps. So Cubix has been an expensive way to increase from 3 cards (using workstation alone) to (5 cards workstation 1 cubix 4)

Tom can you recommend any motherboard CPU Case combo that can take more than 3 cards?

Current Workstation is an Antec 1500 with a ASUS MAXIMUS-VI-EXTREME
Post Reply

Return to “Autodesk 3Ds Max”