OTOY Forums

Hi,

There has to be a bug when rendering animation. On some frames the frame hangs when its finished rendered. It does not save the frame and it does not begin the next one. GPU's does not spin down and keeps going at full throttle but nothing is happening. Its like its gone into an infinite loop at the last sample. Only solution is to save that frame manually and start the rendering again. Its the same frames that hangs the rendering. I have this exact problem at both my machines.

might help
http://render.otoy.com/forum/viewtopic. ... +rendering
seems like PSU type and temperature and cards temperature is what causes most crashes
I keep EVGA precision always on and temp target bellow 65C or it will freeze therefore my power target is 70%

coilbook wrote:might help
http://render.otoy.com/forum/viewtopic. ... +rendering
seems like PSU type and temperature and cards temperature is what causes most crashes
I keep EVGA precision always on and temp target bellow 65C or it will freeze therefore my power target is 70%

It doesn't crash, i save the frame manually and press the cancel render button, then start the rendering again. There is no error or trouble with the octane viewport, it only happens when i render animaiton with the max framebuffer. It sounds very strange that it should get stuck on just a few frames, and exactly the same frames on different machines at the same time (when the frame is finished). If it was the PSU or temperature i would expect the effect to be a little bit random, this is very consistent.

hi nagboy, I've been having the same issue, Coilbook posted it on the Bug forum here http://render.otoy.com/forum/viewtopic.php?f=81&t=41536 would be good if you could copy your case in to there too to help highlight the problem to the devs. I started a whole discussion about it a few weeks ago here http://render.otoy.com/forum/viewtopic.php?f=27&t=41184 but since then it has gone quiet. People are suggesting it's a hardware issue, but I have no problem with any other software with my setup, I've got a 1,500 psu and plenty of cooling, temps are staying very low for my cards. This should really be addressed as I can't leave animations rendering, I have to check them throughout the night otherwise I will wake up and find that it has stopped at the end of a frame early on in the sequence and sat there all night with all my cards on full power doing nothing... or seemingly fighting over which card is going to render those final few samples.

Could you do a test?

Switch off all your GPUs except one and run the animation again.
If it runs without any problems - this is a hardware issue.
If the problem is still here, switch off this GPU and switch on another one and check it again.

Karba wrote:Could you do a test?

Switch off all your GPUs except one and run the animation again.
If it runs without any problems - this is a hardware issue.
If the problem is still here, switch off this GPU and switch on another one and check it again.

Hi Karba, we've got 12 GPUs running and with all 12 it usually takes anywhere from 10 to 500 frames before it will hang. The less GPUs I use it will take 12 times longer to get to that amount of frames. The problem is much more likely on complex scenes, so if I render on one GPU at a time it will take days to just eliminate 1 GPU at a time. The fact that they all render absolutely fine for hours and hours on end and then randomly freeze at the end of a frame really indicated to me that it isn't so much a hardware issue. Why would this be a rare / intermittent problem?

Rico_uk wrote: The fact that they all render absolutely fine for hours and hours on end and then randomly freeze at the end of a frame really indicated to me that it isn't so much a hardware issue.

That is the main indicator of hardware issue is most cases.
How many gpus per PC do you have? 12? Or you use network rendering? Please try to switch off half of them.

That is the main indicator of hardware issue is most cases.
How many gpus per PC do you have? 12? Or you use network rendering? Please try to switch off half of them.

I have 7 GPUs in one machine (3 directly into the motherboard and 4 via a Netstor box), 3 GPUs in another machine
and 2 in another.

I've tried rendering a few GPUs at a time, and I keep thinking that it is working, but then I'll randomly get a stuck frame. The most stable way of rendering I have at the moment is to check the Low Priority checkbox for every card, but even then it does freeze, just much more rarely. I'll do some more troubleshooting though. Is there another recommended stress test / hardware test that might help identify if there is a hardware issue as everything else I do using the cards seems to work no problem, and less complex scenes render without any problems). It does seem to me to be some kind of bottleneck right at the last second when completing the frame.

i think 780 TIs are junk. Titans never gave me any problems. I wish titan would cost less. I have to keep TIs around 65% power target or I get all kind of errors. They just cannot handle this kind of stress.

coilbook wrote:i think 780 TIs are junk. Titans never gave me any problems. I wish titan would cost less. I have to keep TIs around 65% power target or I get all kind of errors. They just cannot handle this kind of stress.

tbh I'm coming to the same conclusion. I bought 12 of the damn things and now I wish I had bought less cards but got the Titans instead