Best Practices For Building A Multiple GPU System

Discuss anything you like on this forum.
Post Reply
User avatar
Notiusweb
Licensed Customer
Posts: 1285
Joined: Mon Nov 10, 2014 4:51 am

Tutor wrote:
The basis for my guess is that I can could run 10 of my 780 Tis air cooled (to max) and overclocked, adequately powered, yielding a score of about 1,184 for 10 of them and about 1,421 for 12 of them (average per single GPU = ~118.4; btw - I've had that score posted in my signature for many months and its been posted here
Hey Tutor,
I noted here that you have posted scores in your signature.

**To have them properly affirmed as a valid score you have to have them certified by your local Department of Rendering Services ("DRS") (http://www.renderment.gov).

To get them certified by DRS, YOU MUST:
-Provide 2 forms of valid DRS approved identification
-provide 2 forms of render proof (screen prints of render score, saved XLS file documenting render score), or a statement detailing why such proof cannot be obtained, and on what basis you have determined the score of application to be accurate.
-provide a photo of such rig which would have generated the score on a typical Octane Bench (or alternative rendering benchmark approved by DRS)
-have a Form 1H7R filled out by the maker of at least two (2) GPUs used in said rig which can verify the authenticity of score

Once you have obtained all of the above, you must submit within 30 days a Form D56 to your local DRS. This can be done in person at a local DRS office, sent by mail, and optionally, completed electronically online through use of the Render Score Submission app-link at (http://www.renderment.gov). Documents must be scanned and uploaded as .pdf files (no larger than 800kb). Failure to have submitted the required forms within 30 days of getting your latest 1H7R form returned will require a new valid current Form 1H7R to be submitted to the respective GPU manufacturer for re-authentication.

Once your file is approved by DSR, Please note that you will next be issued a temporary Official Render Score ("ORS"), which wil contain your ORS ID number.
Next, you will receive in the mail 2 pamphlets that must be signed and certified by you. On these forms you must document the ORS Id number assigned to you in order to be valid for your official certification:
(1) "Understanding Rendering Rights and Responsibilities", and (2) "DRS Rig Compliance Attestation".

Once received by DRS, you will then be issued in the mail your Official DRS Score of Rendation (ODRSSR), which will allow the score to be submitted by mail to your preferred render utility scoring committee at your applicable 3rd Party Rendering Software Company. Following receipt of of your ODRSSR, your score can be mailed in via a DRS Form 817, which allows a 3rd Party Rendering Software Company to post your certified score alongside other users' regular submissions uploaded at time of benchmark. **Please note, DRS is not responsible for any decision by 3rd Party Rendering Software Company to not post your score. DRS is not liable for any failure by 3rd Party Rendering Software Company to post your score. DRS does not hereby guarantee that your score will be posted by said 3rd Party Rendering Software Company.


Just thought you'd like to know!
-Notius
Win 10 Pro 64, Xeon E5-2687W v2 (8x 3.40GHz), G.Skill 64 GB DDR3-2400, ASRock X79 Extreme 11
Mobo: 1 Titan RTX, 1 Titan Xp
External: 6 Titan X Pascal, 2 GTX Titan X
Plugs: Enterprise
User avatar
Tutor
Licensed Customer
Posts: 531
Joined: Tue Nov 20, 2012 2:57 pm
Location: Suburb of Birmingham, AL - Home of the Birmingham Civil Rights Institute

Notius,
Thanks for the detailed guidance.
Because I have 180+ GPU processers in 16 tweaked/multiOS systems - Character limit prevents detailed stats.
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

Guys,

I have some incredible news - I am building next workstation with 7 watercooled GTXs and dual Xeons on AsrockRack mobo - imagine that I just wrote an email to Asrock support and they release a new bios exclusively for me to handle 7 gpus without any problems! And it took one day only. Now when I think about Asus...what a shame.

Stay tuned for build log ;)
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
User avatar
rappet
Licensed Customer
Posts: 1962
Joined: Fri Apr 06, 2012 3:57 pm
Location: The Netherlands
Contact:

smicha wrote:Guys,

I have some incredible news - I am building next workstation with 7 watercooled GTXs and dual Xeons on AsrockRack mobo - imagine that I just wrote an email to Asrock support and they release a new bios exclusively for me to handle 7 gpus without any problems! And it took one day only. Now when I think about Asus...what a shame.

Stay tuned for build log ;)
WOW!... that is more then exciting...
looking forward to that build log.

4090+3089ti & Quad 1080ti
ArchiCAD25, ofcourse Octane & OR-ArchiCAD plugin (love it)
http://www.tapperworks.com
http://www.facebook.com/pages/TAPPERWOR ... 9851341126
http://www.youtube.com/user/Tapperworks/videos
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

Next week or so I shall get all parts. I was thinking about cutting new Titan Xs but we don't know when Octane will use their full speed and they are only available on nvidia website limited to 2 pcs.
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
User avatar
Seekerfinder
Licensed Customer
Posts: 1600
Joined: Tue Jan 04, 2011 11:34 am

smicha wrote:Guys,

I have some incredible news - I am building next workstation with 7 watercooled GTXs and dual Xeons on AsrockRack mobo - imagine that I just wrote an email to Asrock support and they release a new bios exclusively for me to handle 7 gpus without any problems! And it took one day only. Now when I think about Asus...what a shame.

Stay tuned for build log ;)
That's awesome Smicha! Is it on the old X79 Extreme11? Can you share the bios or will they make it available to the Octane community!?
Seeker
Win 8(64) | P9X79-E WS | i7-3930K | 32GB | GTX Titan & GTX 780Ti | SketchUP | Revit | Beta tester for Revit & Sketchup plugins for Octane
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

Seekerfinder wrote:
smicha wrote:Guys,

I have some incredible news - I am building next workstation with 7 watercooled GTXs and dual Xeons on AsrockRack mobo - imagine that I just wrote an email to Asrock support and they release a new bios exclusively for me to handle 7 gpus without any problems! And it took one day only. Now when I think about Asus...what a shame.

Stay tuned for build log ;)
That's awesome Smicha! Is it on the old X79 Extreme11? Can you share the bios or will they make it available to the Octane community!?
Seeker
http://www.asrockrack.com/general/produ ... ifications
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
User avatar
rappet
Licensed Customer
Posts: 1962
Joined: Fri Apr 06, 2012 3:57 pm
Location: The Netherlands
Contact:

smicha wrote:...I am building next workstation with 7 watercooled GTXs and dual Xeons on AsrockRack mobo...
Are the dual Xeon CPU needed to make the 7 GPU work properly, or could you make that 7-GPU build with one i7-cpu as well?
cheers,

4090+3089ti & Quad 1080ti
ArchiCAD25, ofcourse Octane & OR-ArchiCAD plugin (love it)
http://www.tapperworks.com
http://www.facebook.com/pages/TAPPERWOR ... 9851341126
http://www.youtube.com/user/Tapperworks/videos
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

Not on this board. You'd need ASrock x99 ws e
http://www.asrock.com/mb/Intel/X99%20WS-E/
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
User avatar
rappet
Licensed Customer
Posts: 1962
Joined: Fri Apr 06, 2012 3:57 pm
Location: The Netherlands
Contact:

smicha wrote:Not on this board. You'd need ASrock x99 ws e
http://www.asrock.com/mb/Intel/X99%20WS-E/
But i.e. 5820K or other i7 cpu could be sufficient to have 7x GPU work...
There is something about lanes needed in communication from GPU to CPU, right?

4090+3089ti & Quad 1080ti
ArchiCAD25, ofcourse Octane & OR-ArchiCAD plugin (love it)
http://www.tapperworks.com
http://www.facebook.com/pages/TAPPERWOR ... 9851341126
http://www.youtube.com/user/Tapperworks/videos
Post Reply

Return to “Off Topic Forum”