Best Practices For Building A Multiple GPU System

Discuss anything you like on this forum.
Post Reply
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

Tutor wrote:
smicha wrote:...

This is the way I was fighting with 580s instabilities - batter voltage settings helped a little but finally I RMAed them. The risk is greater especially when very long rendering comes to play. And it is mainly due to voltage, not heat when using watercooled GPUs. What is neat - even on stock voltage - Pascals do clock very high and custom modded bios is not that important, unless you want to break a limit for short benchmarks. But as said - for long rendering I would not exceed the limit of stock voltage (around 1.2V).
I agree that clock speed enhancements that depend on exceeding stock voltages aren't recommended, particularly for bios modes because they're a bit harder to correct. Also, I spoke with a Trention sales rep a couple of times yesterday for quotes on the parts that you need, but haven't received any prices yet. Having received no response within more than 24 hrs seems a lot strange to me for products they're marketing.

Thank you. Drop a note if you get any details.
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
User avatar
Tutor
Licensed Customer
Posts: 531
Joined: Tue Nov 20, 2012 2:57 pm
Location: Suburb of Birmingham, AL - Home of the Birmingham Civil Rights Institute

Still no word from Trenton here - which makes me extremely uncomfortable in patronizing them. How about to you?
Because I have 180+ GPU processers in 16 tweaked/multiOS systems - Character limit prevents detailed stats.
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

Tutor wrote:Still no word from Trenton here - which makes me extremely uncomfortable in patronizing them. How about to you?
They emailed me and requested all business data to give me quotes. I'll report if I get anything from them.

Tutor,

here is my build log with full detailed movies - sorry for English. Hope you find it useful.
A video uploaded today.
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
User avatar
Tutor
Licensed Customer
Posts: 531
Joined: Tue Nov 20, 2012 2:57 pm
Location: Suburb of Birmingham, AL - Home of the Birmingham Civil Rights Institute

Thanks Smicha,

Those two systems scream, "Pure Genius and Masterful Execution." But, that not the biggest deal because you keep doing it over and over again, which screams, "Consistent Pure Genius and Consistent Masterful Execution." I envy all of your skills and attention to detail. Cheers for another job very well done!
Because I have 180+ GPU processers in 16 tweaked/multiOS systems - Character limit prevents detailed stats.
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

Tutor wrote:Thanks Smicha,

Those two systems scream, "Pure Genius and Masterful Execution." But, that not the biggest deal because you keep doing it over and over again, which screams, "Consistent Pure Genius and Consistent Masterful Execution." I envy all of your skills and attention to detail. Cheers for another job very well done!
:)
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
User avatar
Notiusweb
Licensed Customer
Posts: 1285
Joined: Mon Nov 10, 2014 4:51 am

Smicha, I never knew you had a channel, cool!
I would be interested to hear the sound of the rig during full blast rendering, probably super quiet.
My rig has always been very noisy...!
Also, in last few months I switched from reg stock Z's to OC Titan Z's, ran into some registry headaches, but since got it going.

Anyway... the builds are absolutely beautiful. Well done!

Hope everyone has a great 2017!
-Notiusweb
Win 10 Pro 64, Xeon E5-2687W v2 (8x 3.40GHz), G.Skill 64 GB DDR3-2400, ASRock X79 Extreme 11
Mobo: 1 Titan RTX, 1 Titan Xp
External: 6 Titan X Pascal, 2 GTX Titan X
Plugs: Enterprise
User avatar
Tutor
Licensed Customer
Posts: 531
Joined: Tue Nov 20, 2012 2:57 pm
Location: Suburb of Birmingham, AL - Home of the Birmingham Civil Rights Institute

I notiused that someone is already having a good year - https://render.otoy.com/octanebench/sum ... TX+TITAN+Z . Congratulations to whomever you are. That bench performance is fantastic! I wonder what was done to achieve it.
Because I have 180+ GPU processers in 16 tweaked/multiOS systems - Character limit prevents detailed stats.
User avatar
Notiusweb
Licensed Customer
Posts: 1285
Joined: Mon Nov 10, 2014 4:51 am

Tutor wrote:I notiused that someone is already having a good year - https://render.otoy.com/octanebench/sum ... TX+TITAN+Z . Congratulations to whomever you are. That bench performance is fantastic! I wonder what was done to achieve it.
'notiused'.... :D
Win 10 Pro 64, Xeon E5-2687W v2 (8x 3.40GHz), G.Skill 64 GB DDR3-2400, ASRock X79 Extreme 11
Mobo: 1 Titan RTX, 1 Titan Xp
External: 6 Titan X Pascal, 2 GTX Titan X
Plugs: Enterprise
User avatar
Tutor
Licensed Customer
Posts: 531
Joined: Tue Nov 20, 2012 2:57 pm
Location: Suburb of Birmingham, AL - Home of the Birmingham Civil Rights Institute

Hello Smicha,

I especially like your Youtube video Part 24.

Which motherboard and case do you intend to use for the upcoming 20 GPU system?
Because I have 180+ GPU processers in 16 tweaked/multiOS systems - Character limit prevents detailed stats.
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

Notiusweb wrote:
Tutor wrote:I notiused that someone is already having a good year - https://render.otoy.com/octanebench/sum ... TX+TITAN+Z . Congratulations to whomever you are. That bench performance is fantastic! I wonder what was done to achieve it.
'notiused'.... :D

Notiusweb,

What a power! Great setup. How much power does it draw?

Could you please do a test for me : watch my video and run orbx in exactly the same way I did on the video and post ms/s
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
Post Reply

Return to “Off Topic Forum”