So this is my 12GPU network, it's just a small home made operation, since I work at home I had my 5 year old son help me with cable connecting of the recently added open rig. Nothing fancy, we're just minding our own business trying to render the projects in time so I can have some free time to spend with my family. And you're telling me that's it ?!? There is nothing more ?!? Don't you understand ? How can I stand in front of my son and tell him that we will never spend our precious father-son time together building computers and expanding our network. Oh I can't tell him that, it would break his heart. So guys, please reconsider raising this limit at least to 16 GPUs for the time being, just so we make it through this Christmas, please !
12 GPU Limit
Forum rules
Please add your OS and Hardware Configuration in your signature, it makes it easier for us to help you analyze problems. Example: Win 7 64 | Geforce GTX680 | i7 3770 | 16GB
Please add your OS and Hardware Configuration in your signature, it makes it easier for us to help you analyze problems. Example: Win 7 64 | Geforce GTX680 | i7 3770 | 16GB
- BorisGoreta
- Posts: 1413
- Joined: Fri Dec 07, 2012 6:45 pm
- Contact:
19 x NVIDIA GTX http://www.borisgoreta.com
Great kid! 

3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
hehe, nice powerhouse =) think You don't need extra heater =DDD
this 12 limit is weird to say the least, even if someOne has hardware
& willing to buy licence OTOY leaves no option..
maybe they will come with Xmas solution before end of the Year? =p
this 12 limit is weird to say the least, even if someOne has hardware
& willing to buy licence OTOY leaves no option..
maybe they will come with Xmas solution before end of the Year? =p
- p3taoctane
- Posts: 1418
- Joined: Mon Jan 25, 2010 12:53 am
Your coffee cup is disproportionately small. You need to upgrade that immediately. The heat generated and energy used from spending time with your family is logarithmic. Every extra hour you spend with them is not linear. For each hour the caffeine intake needs to be to the power of 3. Your cup is clearly a 1. Don't risk that investment and your child labor by skimping on the coffee cup.
A beer stein works well or a left over gallon milk container. I myself try and spend an extra hour or two with my 15 children... (hey I'm saving up for a rugby team) so I use a 55 gallon oil drum.
We need at least 16 GPUs (spare man for the team :> )
A beer stein works well or a left over gallon milk container. I myself try and spend an extra hour or two with my 15 children... (hey I'm saving up for a rugby team) so I use a 55 gallon oil drum.
We need at least 16 GPUs (spare man for the team :> )
Windows 7 Pro_SP 1_64 bit_48 GB Ram_Intel Xeon X5660 2.80 GHZ x2_6 580GTX_1 Quadra 4800
- BorisGoreta
- Posts: 1413
- Joined: Fri Dec 07, 2012 6:45 pm
- Contact:
For the love of our kids, let's make this change, now is the time.
19 x NVIDIA GTX http://www.borisgoreta.com
- Rikk The Gaijin
- Posts: 1528
- Joined: Tue Sep 20, 2011 2:28 pm
- Location: Japan
Do you mind sharing the specs?
- Seekerfinder
- Posts: 1600
- Joined: Tue Jan 04, 2011 11:34 am
Yes please OTOY! A number of us have now been lobbying for an increase...
I say a 24 limit on a local network.
Seeker
I say a 24 limit on a local network.
Seeker
Win 8(64) | P9X79-E WS | i7-3930K | 32GB | GTX Titan & GTX 780Ti | SketchUP | Revit | Beta tester for Revit & Sketchup plugins for Octane
just looking at his signature makes things more or less clear: 8xTITAN | 4x780Rikk The Gaijin wrote:Do you mind sharing the specs?
3x Titans in the box (Guess) + 4x Titans in the Netstor, 1 Titan & 4x 780s in the open rig =)
now that's a powerhouse.. (it would probably melt my electrical wires in the wall =DDD)
- BorisGoreta
- Posts: 1413
- Joined: Fri Dec 07, 2012 6:45 pm
- Contact:
Open rig ingredients:
6 PCI slot ASrock H81 Pro BTC motherboard
http://www.asrock.com/mb/intel/h81%20pro%20btc/
1 Intel SSD
2 DDR3 Memory sticks each 4GB
Seasonic 1000W platinum PSU powering everything except 1 TITAN
Addidional 650W Seasonic PSU for the TITAN
PSU cable that starts second PSU when computer starts
Switch to start the computer
Cheapest Celeron CPU you can find
5 PCI 16x to 1X cables
UTP cable to connect to main computer
all together this costs around 750 EUR
I was thinking about buying a second Netstor box when this open rig came into perspective so I thought I'd try this first and see how it goes. It goes great ! Compared to 1500 EUR the Netsor box costs it is a bargain.
The penalty is that it takes a couple of seconds or a fractions of a second to upload data to the network nodes. But in my case, since I already have one Netstor box connected, it doesn't make sense to buy a second Netstor box since Windows can only handle 8 GPUs in one system so this 2nd Netstor would be a network node also.
The rest is pretty much as glimpse explained. 3 Titans in the main box and 4 in Netstor.
Mother in the main box is ASUS Z9PE-D8 WS
http://www.asus.com/Motherboards/Z9PED8_WS/
with 2 Intel E5-2687W CPUs. 32 GB RAM
As for the GPUs, I think the best ones for openrig systems is ASUS 780 6GB Strix, they are much larger because of their oversized coolers so they might not fit sandwiched in a normal case, but for open rigs they are perfect. Their coolers are so cool that they don't even start spinning when you power on the computer. Only after 15 - 30 seconds of Octane rendering it starts to spin. This cooler is far superior to stock TITAN coolers and the rendering speeds are about the same. Not to mention 780 is much cheaper.
I have also replaced stock Netstor PSU for Seasonic because the stock was very noisy. I always use Seasonic because they are very silent and they seem to be reliable.
Also there was a small fan on the chipset inside Netstor, I just pulled it out becuase again it annoyed me. Works well without it.
6 PCI slot ASrock H81 Pro BTC motherboard
http://www.asrock.com/mb/intel/h81%20pro%20btc/
1 Intel SSD
2 DDR3 Memory sticks each 4GB
Seasonic 1000W platinum PSU powering everything except 1 TITAN
Addidional 650W Seasonic PSU for the TITAN
PSU cable that starts second PSU when computer starts
Switch to start the computer
Cheapest Celeron CPU you can find
5 PCI 16x to 1X cables
UTP cable to connect to main computer
all together this costs around 750 EUR
I was thinking about buying a second Netstor box when this open rig came into perspective so I thought I'd try this first and see how it goes. It goes great ! Compared to 1500 EUR the Netsor box costs it is a bargain.
The penalty is that it takes a couple of seconds or a fractions of a second to upload data to the network nodes. But in my case, since I already have one Netstor box connected, it doesn't make sense to buy a second Netstor box since Windows can only handle 8 GPUs in one system so this 2nd Netstor would be a network node also.
The rest is pretty much as glimpse explained. 3 Titans in the main box and 4 in Netstor.
Mother in the main box is ASUS Z9PE-D8 WS
http://www.asus.com/Motherboards/Z9PED8_WS/
with 2 Intel E5-2687W CPUs. 32 GB RAM
As for the GPUs, I think the best ones for openrig systems is ASUS 780 6GB Strix, they are much larger because of their oversized coolers so they might not fit sandwiched in a normal case, but for open rigs they are perfect. Their coolers are so cool that they don't even start spinning when you power on the computer. Only after 15 - 30 seconds of Octane rendering it starts to spin. This cooler is far superior to stock TITAN coolers and the rendering speeds are about the same. Not to mention 780 is much cheaper.
I have also replaced stock Netstor PSU for Seasonic because the stock was very noisy. I always use Seasonic because they are very silent and they seem to be reliable.
Also there was a small fan on the chipset inside Netstor, I just pulled it out becuase again it annoyed me. Works well without it.
19 x NVIDIA GTX http://www.borisgoreta.com