Best Practices For Building A Multiple GPU System

Discuss anything you like on this forum.
Post Reply
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

Asrock WS E seems to be a very well built board, but the only reason I gave it up for Asus X99 E WS (which I truly regret) were stability issues with Asrock X99 WS (not E).

Tutor,

Guess what? I bet you still have the magic 00 code in front of your eyes :) If the 7 has never come up I have some news for you. I RMAed the board - hoping to be given my money back and bought another one, the one which has problems with 7 gpus after connecting DVI cable. After one month Asus repaired the board and now is sending it back to me. Once I swore on oath that I will never ever buy any Asus product I am pushed against a wall with another of their miraculous Asus X99-E WhataShite motherboard.

So if you still have your '00' boards and you want to get rid of them - Asus will flash them in their factory. But as you said - keeping them as a warning - is probably a better choice.
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
Top
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

Anyone came across on the price of this baby?
http://www.cyclone.com/products/expansi ... 428436.php
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
Top
User avatar
glimpse
Licensed Customer
Posts: 3740
Joined: Wed Jan 26, 2011 2:17 pm
Contact:
Contact glimpse

smicha wrote:Anyone came across on the price of this baby?
http://www.cyclone.com/products/expansi ... 428436.php
interesting piece =)
Top
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

glimpse wrote:
smicha wrote:Anyone came across on the price of this baby?
http://www.cyclone.com/products/expansi ... 428436.php
interesting piece =)

A necessary part for the backplane is here

http://www.ebay.com/itm/Cyclone-Microsy ... SwPe1T5i34

So it works as a set:
http://www.cyclone.com/products/expansi ... 0-2709.php
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
Top
User avatar
Tutor
Licensed Customer
Posts: 531
Joined: Tue Nov 20, 2012 2:57 pm
Location: Suburb of Birmingham, AL - Home of the Birmingham Civil Rights Institute

smicha wrote:Asrock WS E seems to be a very well built board, but the only reason I gave it up for Asus X99 E WS (which I truly regret) were stability issues with Asrock X99 WS (not E).

Tutor,

Guess what? I bet you still have the magic 00 code in front of your eyes :) If the 7 has never come up I have some news for you. I RMAed the board - hoping to be given my money back and bought another one, the one which has problems with 7 gpus after connecting DVI cable. After one month Asus repaired the board and now is sending it back to me. Once I swore on oath that I will never ever buy any Asus product I am pushed against a wall with another of their miraculous Asus X99-E WhataShite motherboard.

So if you still have your '00' boards and you want to get rid of them - Asus will flash them in their factory. But as you said - keeping them as a warning - is probably a better choice.
Smicha,

I don't consider it to be unusual for a purchaser of one type of a manufacturer's motherboards (in my case, three of the same type) to be put off from all of that manufacturer's offerings when the purchaser get a lemon or three. I eat (and grow) lemons because I try to ingest lots of vitamin C, but I don't very much like the taste of lemons. I love (and also grow) strawberries because of their sweet taste and their supplied vitamins and minerals. I prefer the taste of strawberries over the taste of lemons. Though Asus may make other great motherboards, Asus has soured my taste for their produce - Ops, I meant "product." Tyan and Supermicro have never served me lemons, but they both have served me lots of tasty strawberries.
smicha wrote:Anyone came across on the price of this baby?
http://www.cyclone.com/products/expansi ... 428436.php
smicha wrote: ... .

A necessary part for the backplane is here

http://www.ebay.com/itm/Cyclone-Microsy ... SwPe1T5i34

So it works as a set:
http://www.cyclone.com/products/expansi ... 0-2709.php

Thanks a trillion. It would seem to be an excellent technological option for those, like me, who want to reach the new 20 GPU max per Octane License. So, I've request quotes from Cyclone on three 3 meter cables and three backplanes. I anticipate that I to get the master system's bus cards from the E-bay site that you've referenced.
Because I have 180+ GPU processers in 16 tweaked/multiOS systems - Character limit prevents detailed stats.
Top
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

Tutor,

If you don't mind sharing some pricing info on cyclone would be great. I am also curious if there are any requirements for a host cpu - if this backplane can be connected to any machine with 16x PCIe slot...
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
Top
User avatar
Tutor
Licensed Customer
Posts: 531
Joined: Tue Nov 20, 2012 2:57 pm
Location: Suburb of Birmingham, AL - Home of the Birmingham Civil Rights Institute

smicha wrote:Tutor,

If you don't mind sharing some pricing info on cyclone would be great. I am also curious if there are any requirements for a host cpu - if this backplane can be connected to any machine with 16x PCIe slot...

I try to get answers to them all. In the meantime,
You do not have the required permissions to view the files attached to this post.
Last edited by Tutor on Thu May 26, 2016 7:40 pm, edited 1 time in total.
Because I have 180+ GPU processers in 16 tweaked/multiOS systems - Character limit prevents detailed stats.
Top
User avatar
Seekerfinder
Licensed Customer
Posts: 1600
Joined: Tue Jan 04, 2011 11:34 am

Tutor wrote:
Seekerfinder wrote:Does anyone know if it would be possible to use Octane with a networked GPU station on Linux while the main PC is a Windows machine? Does it blend?

Seeker


I have no doubt that it would be possible to use Octane with a networked GPU station on Linux while the primary PC is a Windows OS machine; "Yes, it can be blended," but how and at what costs?
Hi Tutor,
Thanks for the response. I actually thought the answer would be an ' obviously not'... Has the question even been raised before on these forums? With the 20GPU limit and Pascal being a promising card, there's a lot of power to be harnessed. Linux just seems like an ideal network render machine and if Octane plays as nicely between Windows and Linux on the LAN as it promises to do in the cloud, that would be awesome...

Best,
Seeker
Win 8(64) | P9X79-E WS | i7-3930K | 32GB | GTX Titan & GTX 780Ti | SketchUP | Revit | Beta tester for Revit & Sketchup plugins for Octane
Top
User avatar
Seekerfinder
Licensed Customer
Posts: 1600
Joined: Tue Jan 04, 2011 11:34 am

smicha wrote:Asrock WS E seems to be a very well built board, but the only reason I gave it up for Asus X99 E WS (which I truly regret) were stability issues with Asrock X99 WS (not E).

Tutor,

Guess what? I bet you still have the magic 00 code in front of your eyes :) If the 7 has never come up I have some news for you. I RMAed the board - hoping to be given my money back and bought another one, the one which has problems with 7 gpus after connecting DVI cable. After one month Asus repaired the board and now is sending it back to me. Once I swore on oath that I will never ever buy any Asus product I am pushed against a wall with another of their miraculous Asus X99-E WhataShite motherboard.

So if you still have your '00' boards and you want to get rid of them - Asus will flash them in their factory. But as you said - keeping them as a warning - is probably a better choice.
I'd be keen to see the outcome of this one. Please keep us posed Smicha.
I'm actually somewhat disappointed to hear that you had stability issues with the Asrock X99 WS. Some of these WS-E boards are great but pushing them as GPGPU devices has it's limits. The likes of Supermicro and Tyan are just in a different league. But it also seems clear that 2 CPU's of almost any ilk simply handles high lane usage better.
Seeker
Win 8(64) | P9X79-E WS | i7-3930K | 32GB | GTX Titan & GTX 780Ti | SketchUP | Revit | Beta tester for Revit & Sketchup plugins for Octane
Top
User avatar
Tutor
Licensed Customer
Posts: 531
Joined: Tue Nov 20, 2012 2:57 pm
Location: Suburb of Birmingham, AL - Home of the Birmingham Civil Rights Institute

Please see my attachment, above [ Thu May 26, 2016 1:10 pm posting], if you're interested in Cyclone's response to my pricing request. To attach 16 GPUs to that board this is what I have in mind:

https://www.youtube.com/watch?v=BSn3FC_SBPA .

Yes, it a bit coin mining rig setup; however, I'm not going this far - https://www.youtube.com/watch?v=ELA91d_mx80 . Also, I expect (but will also try to confirm) that one's system must be running a Linux OS to handle this no. of GPUs for GPU rendering.
Because I have 180+ GPU processers in 16 tweaked/multiOS systems - Character limit prevents detailed stats.
Top
Post Reply

Return to “Off Topic Forum”