Best Practices For Building A Multiple GPU System

[smicha]

Try this:

1. Keep the project files on the system ssd for now
2. Make sure you have larger cache files size set in windows (try even 100GB, all depends how much RAM you have)

Send feedback.

[Hatsize7]

**SOLVED**
Hi smicha,
Thank you for your reply, I really appreciate it. I wish I saw it sooner, for some reason I didn't get a notification.
Here is my update:
1) I can't keep the project file on the SSD, since I use this multiple GPU machine as a slave, it doesn't have C4D installed on it.
2) it seems raising the Windows Virtual Memory size worked! Thank you so much! It's running smoothly now.
I've set it to 100gb (with 125gb maximum). The machine has 32Gb RAM.

Sometimes the Octane Slave Daemon crashed in a way that I couldn't even end the task in the task manager, the system became completely unresponsive. Needed a hard reset. Now this behavior is gone, it runs as expected.
Thank you again for your help!

[Notiusweb]

Okay - I have now seen the #s coming through for the 2019 RTX Bench, seems awesome!
My rig with 8 mixed Titan Xs got 1265, and someone with 2x 2070 RTX Ti’s got 1298....
That’s quite a performance leap RTX Turing has taken over Pascal, if this type of numeric outcome plays out consistent.

So, I have not yet found a way to crack through the apparent 8 GPU limit. I think my 12 Titan Z + 1 Titan X was either some ability earlier versions of the NVIDIA drivers had, or something to do with the fact that Titan Z was Dual core GPU.

But, so I want to get an RTX card now really bad to replace my Maxwell Titan X.
Only problem is I keep thinking...,
If Pascal to Turing gave us a 3x performance gain, what the heck might the next generation have!!!
I will probably upgrade to one RTX, and then add as time goes.

But F#€% this is awesomeness....I can’t wait to get one

[smicha]

Notiusweb, Having such GPUs as yours I would wait for 3080ti unless you go with watercooling on 2080ti. IMO 2080ti are still way too hot on air and some overheating issues may occur (custom curve with higher RPMs is recommended). Nevertheless I built one machine with 8x2080 ti and it scores 7000. What is significant - RTXs are power hungry - 8x2080ti draw 2000-2200W (entire machine) under Octane, same as 11x1080ti.

[Notiusweb]

Notiusweb, Having such GPUs as yours I would wait for 3080ti unless you go with watercooling on 2080ti. IMO 2080ti are still way too hot on air and some overheating issues may occur (custom curve with higher RPMs is recommended). Nevertheless I built one machine with 8x2080 ti and it scores 7000. What is significant - RTXs are power hungry - 8x2080ti draw 2000-2200W (entire machine) under Octane, same as 11x1080ti.

Thanks for the info on this. I think this type of info is especially pertinent when dealing with a Multi GPU system. I am eyeing more the Titan RTX 24 GB, for the fact that it would not cap my 12 GB VRam at 11 GB like the 2080Ti would.
But I will take you advice and see how this plays out performance wise, I would hate to being in a card that boffs the whole show power and temp wise.

Do you notice temps way out of the ordinary compared to the 1080 Ti, or just slight above what you were able to achieve with the 1080 Ti?

[p3taotoy]

Quick question that I did not see (unless I missed it)

Any intel chip compatible motherboards out there that have a space for two RTX 2080 (The ones I have almost look 2 and a half wide (not double wide... but I am not certain on that) and also have BUILT-IN THUNDERBOLT THREE

or

Another 16 or 8 PCI lane that I can put a thunderbolt 3 card adapter in?

Thanks for any suggestions

( I have an extra GPU enclosure that I can put two more in... I know the speed may not be the same as directly in a 16 lane slot but I do not want a big board that can hold all four for power consumption reasons)

[Notiusweb]

@Smicha....
BTW - 7000 s/px, that would be damn near realtime....

Tutor.....we have to throw away our Titan Z's in the garbage.

[Tutor]

@Smicha....
BTW - 7000 s/px, that would be damn near realtime....

Tutor.....we have to throw away our Titan Z's in the garbage.

I'm not yet ready to do so. I like running all of my systems together.

[Notiusweb]

@Smicha....
BTW - 7000 s/px, that would be damn near realtime....

Tutor.....we have to throw away our Titan Z's in the garbage.

I'm not yet ready to do so. I like running all of my systems together.

I know. You know what really made it suck is that with the driver and Win10 updates, I can only run up to 8 GPUs now.
So, it basically knocked out Titan Z's value on my rig.

[Notiusweb]

I never mentioned, but Evil Santa came when I updated to Win 10 1903...
After updating, I got the itch to try adding in my Titan X's and to my surprise all GPUs can be recognized, so my 8 is now 10 : .

(I do not have my 12 GPU Titan Z rig set up currently.)