12 GPU Limit

Generic forum to discuss Octane Render, post ideas and suggest improvements.
Forum rules
Please add your OS and Hardware Configuration in your signature, it makes it easier for us to help you analyze problems. Example: Win 7 64 | Geforce GTX680 | i7 3770 | 16GB
Post Reply
User avatar
BorisGoreta
Licensed Customer
Posts: 1413
Joined: Fri Dec 07, 2012 6:45 pm
Contact:

So this is my 12GPU network, it's just a small home made operation, since I work at home I had my 5 year old son help me with cable connecting of the recently added open rig. Nothing fancy, we're just minding our own business trying to render the projects in time so I can have some free time to spend with my family. And you're telling me that's it ?!? There is nothing more ?!? Don't you understand ? How can I stand in front of my son and tell him that we will never spend our precious father-son time together building computers and expanding our network. Oh I can't tell him that, it would break his heart. So guys, please reconsider raising this limit at least to 16 GPUs for the time being, just so we make it through this Christmas, please !

PB277257.JPG
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

Great kid! :)
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
User avatar
glimpse
Licensed Customer
Posts: 3740
Joined: Wed Jan 26, 2011 2:17 pm
Contact:

hehe, nice powerhouse =) think You don't need extra heater =DDD

this 12 limit is weird to say the least, even if someOne has hardware
& willing to buy licence OTOY leaves no option..

maybe they will come with Xmas solution before end of the Year? =p
kavorka
Licensed Customer
Posts: 1351
Joined: Sat Feb 04, 2012 6:40 am

Nice bonding time :)

I am assuming at some point there will be extra licenses to buy to increase the limit.
Intel quad core i5 @ 4.0 ghz | 8 gigs of Ram | Geforce GTX 470 - 1.25 gigs of Ram
p3taoctane
Licensed Customer
Posts: 1418
Joined: Mon Jan 25, 2010 12:53 am

Your coffee cup is disproportionately small. You need to upgrade that immediately. The heat generated and energy used from spending time with your family is logarithmic. Every extra hour you spend with them is not linear. For each hour the caffeine intake needs to be to the power of 3. Your cup is clearly a 1. Don't risk that investment and your child labor by skimping on the coffee cup.

A beer stein works well or a left over gallon milk container. I myself try and spend an extra hour or two with my 15 children... (hey I'm saving up for a rugby team) so I use a 55 gallon oil drum.

We need at least 16 GPUs (spare man for the team :> )
Windows 7 Pro_SP 1_64 bit_48 GB Ram_Intel Xeon X5660 2.80 GHZ x2_6 580GTX_1 Quadra 4800
User avatar
BorisGoreta
Licensed Customer
Posts: 1413
Joined: Fri Dec 07, 2012 6:45 pm
Contact:

For the love of our kids, let's make this change, now is the time.
Rikk The Gaijin
Licensed Customer
Posts: 1528
Joined: Tue Sep 20, 2011 2:28 pm
Location: Japan

Do you mind sharing the specs?
User avatar
Seekerfinder
Licensed Customer
Posts: 1600
Joined: Tue Jan 04, 2011 11:34 am

Yes please OTOY! A number of us have now been lobbying for an increase...

I say a 24 limit on a local network.

Seeker
Win 8(64) | P9X79-E WS | i7-3930K | 32GB | GTX Titan & GTX 780Ti | SketchUP | Revit | Beta tester for Revit & Sketchup plugins for Octane
User avatar
glimpse
Licensed Customer
Posts: 3740
Joined: Wed Jan 26, 2011 2:17 pm
Contact:

Rikk The Gaijin wrote:Do you mind sharing the specs?
just looking at his signature makes things more or less clear: 8xTITAN | 4x780

3x Titans in the box (Guess) + 4x Titans in the Netstor, 1 Titan & 4x 780s in the open rig =)

now that's a powerhouse.. (it would probably melt my electrical wires in the wall =DDD)
User avatar
BorisGoreta
Licensed Customer
Posts: 1413
Joined: Fri Dec 07, 2012 6:45 pm
Contact:

Open rig ingredients:

6 PCI slot ASrock H81 Pro BTC motherboard
http://www.asrock.com/mb/intel/h81%20pro%20btc/

1 Intel SSD

2 DDR3 Memory sticks each 4GB

Seasonic 1000W platinum PSU powering everything except 1 TITAN

Addidional 650W Seasonic PSU for the TITAN

PSU cable that starts second PSU when computer starts

Switch to start the computer

Cheapest Celeron CPU you can find

5 PCI 16x to 1X cables

UTP cable to connect to main computer

all together this costs around 750 EUR


I was thinking about buying a second Netstor box when this open rig came into perspective so I thought I'd try this first and see how it goes. It goes great ! Compared to 1500 EUR the Netsor box costs it is a bargain.

The penalty is that it takes a couple of seconds or a fractions of a second to upload data to the network nodes. But in my case, since I already have one Netstor box connected, it doesn't make sense to buy a second Netstor box since Windows can only handle 8 GPUs in one system so this 2nd Netstor would be a network node also.


The rest is pretty much as glimpse explained. 3 Titans in the main box and 4 in Netstor.

Mother in the main box is ASUS Z9PE-D8 WS

http://www.asus.com/Motherboards/Z9PED8_WS/

with 2 Intel E5-2687W CPUs. 32 GB RAM

As for the GPUs, I think the best ones for openrig systems is ASUS 780 6GB Strix, they are much larger because of their oversized coolers so they might not fit sandwiched in a normal case, but for open rigs they are perfect. Their coolers are so cool that they don't even start spinning when you power on the computer. Only after 15 - 30 seconds of Octane rendering it starts to spin. This cooler is far superior to stock TITAN coolers and the rendering speeds are about the same. Not to mention 780 is much cheaper.

I have also replaced stock Netstor PSU for Seasonic because the stock was very noisy. I always use Seasonic because they are very silent and they seem to be reliable.

Also there was a small fan on the chipset inside Netstor, I just pulled it out becuase again it annoyed me. Works well without it.
Post Reply

Return to “General Discussion”