Page 1 of 8

12 GPU Limit

Posted: Wed Dec 03, 2014 1:47 pm
by BorisGoreta
So this is my 12GPU network, it's just a small home made operation, since I work at home I had my 5 year old son help me with cable connecting of the recently added open rig. Nothing fancy, we're just minding our own business trying to render the projects in time so I can have some free time to spend with my family. And you're telling me that's it ?!? There is nothing more ?!? Don't you understand ? How can I stand in front of my son and tell him that we will never spend our precious father-son time together building computers and expanding our network. Oh I can't tell him that, it would break his heart. So guys, please reconsider raising this limit at least to 16 GPUs for the time being, just so we make it through this Christmas, please !

PB277257.JPG

Re: 12 GPU Limit

Posted: Wed Dec 03, 2014 1:58 pm
by smicha
Great kid! :)

Re: 12 GPU Limit

Posted: Wed Dec 03, 2014 2:03 pm
by glimpse
hehe, nice powerhouse =) think You don't need extra heater =DDD

this 12 limit is weird to say the least, even if someOne has hardware
& willing to buy licence OTOY leaves no option..

maybe they will come with Xmas solution before end of the Year? =p

Re: 12 GPU Limit

Posted: Wed Dec 03, 2014 3:05 pm
by kavorka
Nice bonding time :)

I am assuming at some point there will be extra licenses to buy to increase the limit.

Re: 12 GPU Limit

Posted: Wed Dec 03, 2014 3:12 pm
by p3taoctane
Your coffee cup is disproportionately small. You need to upgrade that immediately. The heat generated and energy used from spending time with your family is logarithmic. Every extra hour you spend with them is not linear. For each hour the caffeine intake needs to be to the power of 3. Your cup is clearly a 1. Don't risk that investment and your child labor by skimping on the coffee cup.

A beer stein works well or a left over gallon milk container. I myself try and spend an extra hour or two with my 15 children... (hey I'm saving up for a rugby team) so I use a 55 gallon oil drum.

We need at least 16 GPUs (spare man for the team :> )

Re: 12 GPU Limit

Posted: Wed Dec 03, 2014 4:52 pm
by BorisGoreta
For the love of our kids, let's make this change, now is the time.

Re: 12 GPU Limit

Posted: Thu Dec 04, 2014 4:32 am
by Rikk The Gaijin
Do you mind sharing the specs?

Re: 12 GPU Limit

Posted: Thu Dec 04, 2014 10:22 am
by Seekerfinder
Yes please OTOY! A number of us have now been lobbying for an increase...

I say a 24 limit on a local network.

Seeker

Re: 12 GPU Limit

Posted: Thu Dec 04, 2014 10:38 am
by glimpse
Rikk The Gaijin wrote:Do you mind sharing the specs?
just looking at his signature makes things more or less clear: 8xTITAN | 4x780

3x Titans in the box (Guess) + 4x Titans in the Netstor, 1 Titan & 4x 780s in the open rig =)

now that's a powerhouse.. (it would probably melt my electrical wires in the wall =DDD)

Re: 12 GPU Limit

Posted: Thu Dec 04, 2014 12:10 pm
by BorisGoreta
Open rig ingredients:

6 PCI slot ASrock H81 Pro BTC motherboard
http://www.asrock.com/mb/intel/h81%20pro%20btc/

1 Intel SSD

2 DDR3 Memory sticks each 4GB

Seasonic 1000W platinum PSU powering everything except 1 TITAN

Addidional 650W Seasonic PSU for the TITAN

PSU cable that starts second PSU when computer starts

Switch to start the computer

Cheapest Celeron CPU you can find

5 PCI 16x to 1X cables

UTP cable to connect to main computer

all together this costs around 750 EUR


I was thinking about buying a second Netstor box when this open rig came into perspective so I thought I'd try this first and see how it goes. It goes great ! Compared to 1500 EUR the Netsor box costs it is a bargain.

The penalty is that it takes a couple of seconds or a fractions of a second to upload data to the network nodes. But in my case, since I already have one Netstor box connected, it doesn't make sense to buy a second Netstor box since Windows can only handle 8 GPUs in one system so this 2nd Netstor would be a network node also.


The rest is pretty much as glimpse explained. 3 Titans in the main box and 4 in Netstor.

Mother in the main box is ASUS Z9PE-D8 WS

http://www.asus.com/Motherboards/Z9PED8_WS/

with 2 Intel E5-2687W CPUs. 32 GB RAM

As for the GPUs, I think the best ones for openrig systems is ASUS 780 6GB Strix, they are much larger because of their oversized coolers so they might not fit sandwiched in a normal case, but for open rigs they are perfect. Their coolers are so cool that they don't even start spinning when you power on the computer. Only after 15 - 30 seconds of Octane rendering it starts to spin. This cooler is far superior to stock TITAN coolers and the rendering speeds are about the same. Not to mention 780 is much cheaper.

I have also replaced stock Netstor PSU for Seasonic because the stock was very noisy. I always use Seasonic because they are very silent and they seem to be reliable.

Also there was a small fan on the chipset inside Netstor, I just pulled it out becuase again it annoyed me. Works well without it.