Build a custom render rig with 10.000+ renderpower

Generic forum to discuss Octane Render, post ideas and suggest improvements.
Forum rules
Please add your OS and Hardware Configuration in your signature, it makes it easier for us to help you analyze problems. Example: Win 7 64 | Geforce GTX680 | i7 3770 | 16GB
Post Reply
ArneGoossens
Licensed Customer
Posts: 2
Joined: Mon May 30, 2016 7:24 am
Location: Hilversum, Netherlands
Contact:

Hi Guys,

For a big project that's coming up this summer at the tv channel I'm working at, I'm going to have to render 3 minutes of video, 50 frames per second (9000 frames), with a resolution of 11400x1920. It's for a big panorama experience during a tv conference in October. Deadline: October 1st.
My current render time is 35 minutes per frame with an Octane Benchscore of 220.

- Total frames: (3 minutes, 50 fps) 9000 Frames.
- Minutes / frame 35 min.
- Total rendertime: 218 DAYS.

So, I should have started rendering on February 25th....

My question:
- What is the best way to build a custom render rig that brings back my rendering time down to 4 days? Octane Bench Power =~ 12000
- That can be mounted inside a 19" Server rack.

I'm thinking about using this option, that Kandori07 shared: http://amfeltec.com/products/gpu-oriented-cluster/
But I would preferably built a more sturdy solid solution, one that fits inside a render rack that is constantly cooled by high power airconditioning.

OR, if someone knows of company that can builts these types of rigs, please let me know.
FYI, I'm based in The Netherlands.

Hope you can help me out!
Thanks in advance


With regards,

Kevin Mulder.
Promo Producer
[email protected]
Last edited by ArneGoossens on Fri Jul 08, 2016 2:22 pm, edited 1 time in total.
HP Z840
3 HP Z840s:
- Intel(R) Xeon(R) CPU E5-2680 v3 @2 2x.50 GHz
- 128GB DDR
- Quadro K5200 (1 has a M5000)
- Windows 10
User avatar
Phantom107
Licensed Customer
Posts: 686
Joined: Tue Jul 24, 2012 11:31 am
Location: The Netherlands

Seems to me you should be looking into Octane cloud solutions instead??
ArneGoossens
Licensed Customer
Posts: 2
Joined: Mon May 30, 2016 7:24 am
Location: Hilversum, Netherlands
Contact:

Thanks for your reply.

I have, but a one time render cloud option is going to cost me around 10.000 at UltraRender.
The demand for 3D animations is rapidly increasing, so buying/building a rig feels like a viable option to check out...
HP Z840
3 HP Z840s:
- Intel(R) Xeon(R) CPU E5-2680 v3 @2 2x.50 GHz
- 128GB DDR
- Quadro K5200 (1 has a M5000)
- Windows 10
User avatar
Phantom107
Licensed Customer
Posts: 686
Joined: Tue Jul 24, 2012 11:31 am
Location: The Netherlands

Just did a bench on my own system 1 with 3x 980 ti, scored 382.... I now understand the amount of power you are going to need is completely insane.

12000/(382/3) = 94 GTX 980 Ti cards required
Model I got is EVGA GeForce GTX 980 Ti SC GAMING, € 509 a piece (comparable with a GTX 1070 which is not yet supported by Octane as far as I know)
94 * 509 = € 47846
Business expense so no 21% tax, 47846/1.21 = € 39542

:o
salmon
Licensed Customer
Posts: 42
Joined: Sun Jun 30, 2013 3:50 pm

I know this people, azken.com, they build GPU Racks : http://www.azken.com/Productos/Index/Se ... %20HPC/358
User avatar
Goldorak
OctaneRender Team
Posts: 2321
Joined: Sun Apr 22, 2012 8:09 pm
Contact:

ArneGoossens wrote:Hi Guys,

For a big project that's coming up this summer at the tv channel I'm working at, I'm going to have to render 3 minutes of video, 50 frames per second (9000 frames), with a resolution of 11400x1920. It's for a big panorama experience during a tv conference in October. Deadline: October 1st.
My current render time is 35 minutes per frame with an Octane Benchscore of 220.

- Total frames: (3 minutes, 50 fps) 9000 Frames.
- Minutes / frame 35 min.
- Total rendertime: 218 DAYS.

So, I should have started rendering on February 25th....

My question:
- What is the best way to build a custom render rig that brings back my rendering time down to 4 days? Octane Bench Power =~ 12000
- That can be mounted inside a 19" Server rack.

I'm thinking about using this option, that Kandori07 shared: http://amfeltec.com/products/gpu-oriented-cluster/
But I would preferably built a more sturdy solid solution, one that fits inside a render rack that is constantly cooled by high power airconditioning.

OR, if someone knows of company that can builts these types of rigs, please let me know.
FYI, I'm based in The Netherlands.

Hope you can help me out!
Thanks in advance


With regards,

Kevin Mulder.
Promo Producer
[email protected]
This is the ideal use case for ORC. Yes, it will cost a heck of a lot (in line with the prices on this thread, above $10 but below $20K I am estimating...but... if you want to go from 281 days to 281 minutes, ORC can do that by rendering 1440 frames on 1440 GPUs at once.

Realistically, 144 GPUs running over 4 days on ORC may be more likely to give you best price for this job, if you don't need it back in a matter of hours. There is a potential premium when roping in 1000s of GPUs at once for a single customer on ORC, so we haven't been pushing because it may be overkill even in this case- but let us know.
User avatar
gabrielefx
Licensed Customer
Posts: 1701
Joined: Wed Sep 28, 2011 2:00 pm

I think that there are many things to consider

the resolution you need to fill can be reduced then enlarged with After Effects. Many people can't distinguish between a 2K to 4K upscale. There are some plugins that do very well this job.

Your benchmarks on what gpus are based? I read you have some slow Nvidia Quadros.

You can buy 2 quad Titan X rigs for a total of 8 gpus. I say 2 rigs because if one fails you can continue your work while the other machine is repaired.

You can spend about 14.000€ for two complete systems witho o.s., ssd disks, i7 processors, 32GB, Asus mb and case.

Also your scene can be optimized clamping the GI and/or using some tricks to speed up the render time.

regards
quad Titan Kepler 6GB + quad Titan X Pascal 12GB + quad GTX1080 8GB + dual GTX1080Ti 11GB
Post Reply

Return to “General Discussion”