cheap 6 GPU air cooled rig

Discuss anything you like on this forum.
Post Reply
User avatar
slepy8
Licensed Customer
Posts: 377
Joined: Sun Jul 14, 2013 10:53 am

Yo!

I like to create things :)

So I'll show you how I made my rig capable of holding up to 6 GPU's and still being pretty quiet and cool.

Goals:
1. up to 6 GPU's
2. quiet
3. good cooling
4. reasonable price

I used ASROBK H81 pro BTC motherboard.
It has some limitations but I can live with them.
I used MSI Z87-G45 before but couldn't connect 3GPU's to the mobo. The bluescreen appeared each time. No help from MSI support. It's a shit company. Even my computer-store sellers told me that..

I used this thing. It's designed to work with multiple GPU's.
Image

1. Preparations

I decided to pack everything into one box. But there is no box for 6 GPU's on the market instead od Cubix which costs way too much for me. So I decided to connect two computer boxes into one.
In one keep PSU, display GPU and mobo, and in another one, only additional GPU's (and in the future additional PSU).

First mobo tests.
Image

Rebuilding the GPU box:

Image
Image
Image
Image

GPU's need two rails to be attached:
Image
Image

Testing - it will fit :)
Image

Now cooling.
I bought some "quiet" fans. As far as GPU's can generate lots of temperature I decided to attach 3 fans (pushing) on one side, controlled with switches and two high speed fans (pulling) controlled from Speedfan software.

Image
Image

the switches:
Image

On top of "main" box there are two slots for fans. They are covered with grates which are too noisy.
Get rid of the grate :)
Image

And replace it with the "quiet" grates:
Image

Now making it all quiet..
I bought the "acoustic foam" which has one sticky side.
I've covered each part that could emmit any sound out of the boxes, but left some "maintanance" spaces as well.

the foam:
Image

Image
Image
Image

Some foam on one rail so the GPU doesn't fall into vibrations:
Image

Foam between two boxes to keep them quiet:
Image

To connect GPU's you'll need powered up risers. I chose the USB risers. They are 60cm long. The ones that has 1X slot, and the additional molex power connector.
So you'll need additional molex cable from your PSU to power up risers.

Happily I'm Corsair AX1200 owner so each cord is modular. I could even get one more molex cord to power up my side fans.
Image

After you connect two boxes you'll need to move it from time to time. So I "designed" :D two handles. They are connected with screws attaching two boxes to each other.
Image

After everything was set up it's time to connect all cables and close side lids.
Image
Image

In the end. What has and what hasn't been achieved :)

1. Space - enough too put in 2slots-wide X 6 GPU's.
2. Temperatures - at this moment running only 780Ti and 2 X 660 I don't need to run side fans. The top fans at low speeds do their job. After I add more GPU's, there will be still enough air blow to keep them at proper temps.
3. Noise - forget about water cooling noise level with this rig :D You hear it but it's not disturbing. I wish I had more cash to spend on water cooling, but since I don't have - this rig is extremely quiet to me :D
4. price - old PC box - no $. some fans, wires.., I don't know how much it costed but low enough not to count it. The fun when it all comes to life - priceless ;)
5. Performance - I don't know what's the myth with textures load on 1X PCI-e slots. I get almost same times on the same scenes. The overall performance is normal as with any other mobo I used.

The next goal is getting enough work on my shoulders to fill the "GPU box" with only 780Ti's ;)
The brand new one comes soon though.
Last edited by slepy8 on Thu Apr 24, 2014 6:02 am, edited 1 time in total.
ten
Licensed Customer
Posts: 218
Joined: Fri Apr 18, 2014 10:43 am
Location: England

Very cool!

So using 1x pcie slots does not limit bandwidth to the gpu's from octane or render times in anyway?

Ten
( PC ) i7 5960x octal 4.5ghz / 64GB / 2x Titan X 12GB / 1x 780 6GB - ( Laptop ) i7 4790k 4ghz / 32GB / 980M 8GB - Octane CD4 2.x / C4DR16.x / win 8.x
User avatar
slepy8
Licensed Customer
Posts: 377
Joined: Sun Jul 14, 2013 10:53 am

I haven't noticed.

And according to benchmarks - all's fine.

However - what would be the reason??
ten
Licensed Customer
Posts: 218
Joined: Fri Apr 18, 2014 10:43 am
Location: England

Well, I don't know how much bandwidth octane uses to communicate with the cards. If it's under x1 at 2.0 spec it's fine, but if it's more you will loose performance no?

Also do the extra lanes not supply more power to the cards also? Will x1 supply enough power to the latest power hungry cards?

Ten
( PC ) i7 5960x octal 4.5ghz / 64GB / 2x Titan X 12GB / 1x 780 6GB - ( Laptop ) i7 4790k 4ghz / 32GB / 980M 8GB - Octane CD4 2.x / C4DR16.x / win 8.x
User avatar
rappet
Licensed Customer
Posts: 1962
Joined: Fri Apr 06, 2012 3:57 pm
Location: The Netherlands
Contact:

I love it :!: :!:
Thanx for sharing slepy8 :mrgreen:
What is the total weight of your powerbox?
Greetz,

4090+3089ti & Quad 1080ti
ArchiCAD25, ofcourse Octane & OR-ArchiCAD plugin (love it)
http://www.tapperworks.com
http://www.facebook.com/pages/TAPPERWOR ... 9851341126
http://www.youtube.com/user/Tapperworks/videos
User avatar
ROUBAL
Licensed Customer
Posts: 2199
Joined: Mon Jan 25, 2010 5:25 pm
Location: FRANCE
Contact:

Impressive work !
So using 1x pcie slots does not limit bandwidth to the gpu's from octane or render times in anyway?
Maybe not noticeable on a small/medium scene for rendering still pictures, but imho if you render a big scene with moving geometries reloaded each frame, you will see the difference with 8x or 16 x slots.

Currently my Cubix box is on a 4x PCIe slot,as my Mobo is an old Asus P5k. The loading time is rather long, but I have no comparison value.
French Blender user - CPU : intel Quad QX9650 at 3GHz - 8GB of RAM - Windows 7 Pro 64 bits. Display GPU : GeForce GTX 480 (2 Samsung 2443BW-1920x1600 monitors). External GPUs : two EVGA GTX 580 3GB in a Cubix GPU-Xpander Pro 2. NVidia Driver : 368.22.
User avatar
slepy8
Licensed Customer
Posts: 377
Joined: Sun Jul 14, 2013 10:53 am

@rappet - I didn't weight it but seems like about 15-20kg I think. I need to make a hadle on top so I it becomes more portable :D

@Roubal - I made some tests. The differences were such small, that I consider it's because of some randomness in values at each time you load the scene.
prehabitat
Licensed Customer
Posts: 495
Joined: Fri Aug 16, 2013 10:30 am
Location: Victoria, Australia

Hey Slepy8, great work!

I've been tempted by those powered x1 -> x16 adapters in the past - glad to see they do work with Octane! thanks! :D

You may lose one slot thought unless you use a x16-> x16 riser - the edge of your double-slot card which is motherboard mounted will block one of the x1 slots?
Win10/3770/16gb/K600(display)/GTX780(Octane)/GTX590/372.70
Octane 3.x: GH Lands VARQ Rhino5 -Rhino.io- C4D R16 / Revit17
User avatar
Refracty
Licensed Customer
Posts: 1599
Joined: Wed Dec 01, 2010 6:42 pm
Location: 3D-Visualisierung Köln
Contact:

I think that the difference between 1x and 8x is only the transfer speed during opening a file. But render time should be fine.
User avatar
slepy8
Licensed Customer
Posts: 377
Joined: Sun Jul 14, 2013 10:53 am

@prehabitat - you are right. But it's not my concern now since I don't even have 5 cards onboard :)

@refracty - Exactly. There is small difference in scene loading time, but none in rendering.
Post Reply

Return to “Off Topic Forum”