Best Practices For Building A Multiple GPU System

Discuss anything you like on this forum.
Post Reply
User avatar
Tutor
Licensed Customer
Posts: 531
Joined: Tue Nov 20, 2012 2:57 pm
Location: Suburb of Birmingham, AL - Home of the Birmingham Civil Rights Institute

smicha wrote:S8 'cause it's half of the size of STH10 and can handle 3x360 rads easily. Plus a pedestal is available.
Smicha,
I look forward to your continuing to be the beacon of light that you have certainly been in the past.

After looking at all of the current CaseLab (California Company) offerings, the biggest Magnums - the 10s ( ~$500-600+ (USD)) come closest to being able to fit my needs. However, given my GPU consolidation goals at this stage in my business' development I still tend to lean more in the direction of the Lian-Li (Taiwan Company)'s old D8000s cases because they allow me to easier make the mods that I have in mind - like adding 15+ GPUs, 4 PSUs, etc. - all in one enclosure. Moreover, I've been able to find D8000s new for about $350 (USD) including shipping. Admittedly I've earned the title of Mr. Cheapo, but I'd rather have more money to spend on GPUs. Nevertheless, despite my personal hardware preferences for the sort of studio I've been constantly building to suite my particular business model, I continue to take great pleasure in learning more about what other business professionals are doing and their reasons for doing so. So by all means let the information continue to flow. By the way, is your business/output need more still graphic, animation or AV oriented (or a particular combo thereof)?*/ Knowing more detail about what someone outputs (i.e., more about their intended system use) tends to help a subsequent reader to better understand the output/process to which a question(s) may relate and to assess/develop their own business needs/direction and better understand how particular hardware choices have been influenced and the relevancy of those choices to what the reader does.


*/ Any others poster to this forum, would you please provide this information too? Just once is fine.
Because I have 180+ GPU processers in 16 tweaked/multiOS systems - Character limit prevents detailed stats.
User avatar
Notiusweb
Licensed Customer
Posts: 1285
Joined: Mon Nov 10, 2014 4:51 am

By the way, is your business/output need more still graphic, animation or AV oriented (or a particular combo thereof)?
I have had plugin for (1) Daz Studio longest, now just recently (2) Sketchup and (3) Cinema 4D. (Enjoy Daz a lot, but looking to expand my art in 2 more directions, (2) technical scene, and (3) cinematic effect, respectively...)
Handle both animation and still renders...
If only still renders, I could use the Titan X all by itself, and a lot of times I do. You just have to leave your PC with the option to go solo with a 12GB card so you can use its 12GB VRAM when designing. I am so please with this card, it really impresses me with all it can do. If you have any purpose for a single use card, you will not regret getting the Titan X...although soon, yes, will be outdone by Pascal. I can't wait...
For animations, GPU things as extreme as you can go + leave room for flexibility (my motto). If your rig works in a given case (pun intended), then good. Hopefully you don't have to force it to work. In my scenario, a case was just never even considered because Titan Z is 3 slots wide. But now I see it as 3 slots wide of goodness, and if some Super Pascal card is 4 slots wide, no problemo.

Messing with Daz
Zombo1.png

Messing with Sketchup
The Kitchening.png
Messing with C4D
...I'm getting there....
You do not have the required permissions to view the files attached to this post.
Win 10 Pro 64, Xeon E5-2687W v2 (8x 3.40GHz), G.Skill 64 GB DDR3-2400, ASRock X79 Extreme 11
Mobo: 1 Titan RTX, 1 Titan Xp
External: 6 Titan X Pascal, 2 GTX Titan X
Plugs: Enterprise
User avatar
Notiusweb
Licensed Customer
Posts: 1285
Joined: Mon Nov 10, 2014 4:51 am

Okay, getting there with C4D...
Daz n Sketchup.png
Daz n Sketchup2.png

For animations...yes...as many High VRAM GPUs as possible...12+ (# GPU and VRAM GB)
GPU.png
And system RAM.
RAM.png
Need more RAM....MORE RAM!....RAM RAM RAM!
You do not have the required permissions to view the files attached to this post.
Win 10 Pro 64, Xeon E5-2687W v2 (8x 3.40GHz), G.Skill 64 GB DDR3-2400, ASRock X79 Extreme 11
Mobo: 1 Titan RTX, 1 Titan Xp
External: 6 Titan X Pascal, 2 GTX Titan X
Plugs: Enterprise
User avatar
Tutor
Licensed Customer
Posts: 531
Joined: Tue Nov 20, 2012 2:57 pm
Location: Suburb of Birmingham, AL - Home of the Birmingham Civil Rights Institute

Notiusweb wrote:Okay, getting there with C4D...
Daz n Sketchup.png
Daz n Sketchup2.png

For animations...yes...as many High VRAM GPUs as possible...12+ (# GPU and VRAM GB)
GPU.png
And system RAM.
RAM.png
Need more RAM....MORE RAM!....RAM RAM RAM!

Thanks for the posts about your 3d usage. Love those pics.
I've started using C4D in the early 1990's on my Amiga. I found C4D to be very capable, as well as easy to learn. Also, I agree with you about the need for lots of ram, particularly to take full advantage of the new features in Octane 3 and when working with lots of the latest GPUs.
Because I have 180+ GPU processers in 16 tweaked/multiOS systems - Character limit prevents detailed stats.
User avatar
rappet
Licensed Customer
Posts: 1962
Joined: Fri Apr 06, 2012 3:57 pm
Location: The Netherlands
Contact:

Tutor wrote:...
... I found C4D to be very capable, as well as easy to learn.
Hi Tutor,
This part is little out of topic here, but anyway..
I find C4D hard to learn by myself. I have teached my self a lot of software and for modelling first AutoCAD, then ArchiCAD.. all autodidact. It seems that my click is missing with C4D and I have to find me a way to make that click happen.
Did you find it easy to learn by self-instruct or did happen to find some good instructions that ade it easy for you?
greetz,

4090+3089ti & Quad 1080ti
ArchiCAD25, ofcourse Octane & OR-ArchiCAD plugin (love it)
http://www.tapperworks.com
http://www.facebook.com/pages/TAPPERWOR ... 9851341126
http://www.youtube.com/user/Tapperworks/videos
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
User avatar
rappet
Licensed Customer
Posts: 1962
Joined: Fri Apr 06, 2012 3:57 pm
Location: The Netherlands
Contact:

smicha wrote:https://youtu.be/HFs-a9VzrSU
Oh, I wish I was born yesterday instead and be able to see more of what the futures brings... :o
Exciting times ahead.

4090+3089ti & Quad 1080ti
ArchiCAD25, ofcourse Octane & OR-ArchiCAD plugin (love it)
http://www.tapperworks.com
http://www.facebook.com/pages/TAPPERWOR ... 9851341126
http://www.youtube.com/user/Tapperworks/videos
User avatar
Notiusweb
Licensed Customer
Posts: 1285
Joined: Mon Nov 10, 2014 4:51 am

Postby smicha » Sun Jan 10, 2016 11:19 pm
https://youtu.be/HFs-a9VzrSU
LOL, all this time the perfect case is actually a car.
We'd have to mod the car so we can render as we're driving, and expand the #GPUs so we can achieve the dream - A Big Gas Guzzling Muscle car with 24 GPUs... :P
by rappet » Sun Jan 10, 2016 11:50 am
Hi Tutor,
This part is little out of topic here, but anyway..
I find C4D hard to learn by myself. I have teached my self a lot of software and for modelling first AutoCAD, then ArchiCAD.. all autodidact. It seems that my click is missing with C4D and I have to find me a way to make that click happen.
Did you find it easy to learn by self-instruct or did happen to find some good instructions that made it easy for you?
greetz,
Not to step in Tutor's way, I know he will give his thoughts. But, I feel you on this. C4D has an immense deal of new stuff to figure out (for us) and it is not as intuitive, seemingly. Just know that we're not used to it yet, so don't be down on yourself for not picking it up and becoming master all on your own. What I've been doing is looking at it with a trouble shooting methodology. I start by saying, "I don't know this at all, but I want to do 'X'". Make 'X' be a specific goal, even if an overreaching compounded goal. Like, I want to have swirling flame surround a sphere as it morphs into text. There's several components to that, just identify them - (1) making a sphere, (2) key-framing on the timeline (3) making text, (4) creating a fire volume, (5) setting camera angles, etc. So, identify things maybe you know already, like making a sphere, and then look for resources (video tutorials, web tutorials, posts, etc.) that focus on the next easiest thing to tackle, like making text or navigating key-frames on the timeline. Before you know it you will have a baseline experience in having created something. Then, move onto the next easiest thing, and before you know it, you'll have learned how to do a simple version of what you want, as well as learned probably a whole lot of things on the side. Take good notes (save scenes, pictures, screenshots, etc.) because you will forget. Then, you will be on your way to having it click, and the expert knowledge is absorbed much more quickly. In the Octane Daz forums (2015) we were busy learning how to use workarounds while the plugin went through a developer change, and boy it was frustrating as hell to have to have things be so tedious and un-automatic, BUT it made us all experts in using the app and plugin because we constantly were trouble shooting what we could and couldn't do, while identifying what we wanted to do in a step-like fashion... When the plugin finally got up to speed with the new developer on board, we all had developed so much more in using the app and plugin.

To me, the clicking sound happens when you're not stressing about it and you look forward to learning and mastering something new because your accomplishments are acknowledged as rewards for having taken on the challenge. With that, neurons are set up properly to fire rapidly when accessing the new memory cells because the learning then "feels good", and in itself is a reinforcer. Just my thoughts. :)
Win 10 Pro 64, Xeon E5-2687W v2 (8x 3.40GHz), G.Skill 64 GB DDR3-2400, ASRock X79 Extreme 11
Mobo: 1 Titan RTX, 1 Titan Xp
External: 6 Titan X Pascal, 2 GTX Titan X
Plugs: Enterprise
User avatar
Tutor
Licensed Customer
Posts: 531
Joined: Tue Nov 20, 2012 2:57 pm
Location: Suburb of Birmingham, AL - Home of the Birmingham Civil Rights Institute

rappet wrote:
Tutor wrote:...
... I found C4D to be very capable, as well as easy to learn.
Hi Tutor,
This part is little out of topic here, but anyway..
I find C4D hard to learn by myself. I have teached my self a lot of software and for modelling first AutoCAD, then ArchiCAD.. all autodidact. It seems that my click is missing with C4D and I have to find me a way to make that click happen.
To me, your question isn't off topic. Here's a little background information about me to put my following answer to your question in better context.
My BackGround
Last year, I celebrated my 62nd birthday. As to my formal schooling, I most enjoyed art, math, chemistry, physics, astronomic, biology and law, as well as shop classes (including, but not limited to, electronics, wood, metal, and print), and I participated in weightlifting, track and field, football and basketball during high school and college. Also, I was our church's organist since about the age of six. Of course, I can play the piano and now I'm learning to better play the trumpet, harmonica, saxophone and guitar to complement my video productions.

I also was, and still am, a Mac user - having been a Mac user since 1985, using it for music and still art production. I began using the Amiga in 1988-89. I have been using Windows systems since around 1986, but did not begin to use them for creative work until the late 1990s (until then the Macs and Amiga's prevailed in music and the arts and they were the only real games in town until Linux-based creative software open their doors to other OSes).*/ I started creating 2d animations in the late 1980's on the Commodore Amiga. Then in 1990, Newtek introduced LightWave 3d as part of the Video Toaster system (Amiga based) - two of which I immediately purchased and still own and use to this day. In 1993, Maxon released Cinema4d (C4d) (also Amiga based) which I immediately acquired to complement my two Lightwave seats. I've been a tweaker all of my electronic-filled life and I still own and use almost every system which I've ever purchased. Also I, myself, am their repairman. My Atari TT030 (now a 040) still runs Cubase perfectly for music production. I have fully functioning and tweaked to the max vintage systems such as Power Macintoshes (9600/200s, 8500/120s, 8100/80s) and Amiga (500s, 2,000s, 3,000s, and 4,000s), as well as Power Computing 210s (that's when Apple allowed clones). Every system that I've ever bought or built, and still own, still runs. The ones that I no longer own I gave (in perfect running condition) to other's children to help spread interest in technology.
rappet wrote:Did you find it easy to learn by self-instruct or did happen to find some good instructions that ade it easy for you?
greetz,
When I began learning to us C4d, the manual was all there was; but then that was twenty-three years ago when the program was a lot more basic than it is now. Was C4d then easy for me to learn by self-instruction? Yes, it was for me, but then was almost a quarter of a century ago, and for me, learning never stops and using what I've learned is paramount. However, then there was (a) no You Tube ( https://www.youtube.com/results?search_query=cinema4d ), no Vimeo ( https://vimeo.com/channels/bestofc4d ), etc., (b) no centers for C4d education/videos - no Digital Tutors ( http://www.digitaltutors.com/software/C ... -tutorials ), no Lynda ( http://www.lynda.com/CINEMA-4D-training ... 173-0.html ), no FXPHD ( https://www.fxphd.com/fxphd/courseInfo.php ) etc., not to mention no Greyscalegorilla ( https://store.greyscalegorilla.com ) . And there was not even then a hint of a Cineversity ( http://www.cineversity.com ). So over that span of time I've continued to learn about C4d from various sources, but Cinversity would appear to be an excellent place to start.


*/ I run all three of the major OSes on my newer - post 2009 - systems.

P.S. - Today I took a couple of pics of two of my vintage systems - my Atari TT040, formerly a TT030, and one of my two tweaked Video Toaster systems.
You do not have the required permissions to view the files attached to this post.
Last edited by Tutor on Mon Jan 11, 2016 10:25 pm, edited 3 times in total.
Because I have 180+ GPU processers in 16 tweaked/multiOS systems - Character limit prevents detailed stats.
User avatar
smicha
Licensed Customer
Posts: 3151
Joined: Wed Sep 21, 2011 4:13 pm
Location: Warsaw, Poland

You are the light, Tutor.
3090, Titan, Quadro, Xeon Scalable Supermicro, 768GB RAM; Sketchup Pro, Classical Architecture.
Custom alloy powder coated laser cut cases, Autodesk metal-sheet 3D modelling.
build-log http://render.otoy.com/forum/viewtopic.php?f=9&t=42540
Post Reply

Return to “Off Topic Forum”