crashes every x frames

[philmaron]

After having an issue with a heavy scene, making it crash every 20 frames, more or less, I decided to reinstall my gpu-drivers. Did not help. Now I realise older stable scenes, when rerendering, crash every few frames aswell. The error is "cant unload gpu memory, device x deactivated". So I browsed through the forums and manually changed the registry TdrDelay to 60, as Bepe mentioned in an older topic. The rendering didnt crash, but what started with 1 minute 50 per frame ended in 16 hours for 300 frames, frame times getting longer. The displayed memory shrunk to 2.4gb available, even though it should be around 7.6 given I use 3080 and have 4k monitor.

how could i troubleshoot?

[aoktar]

Maybe you're near to limits of system and gpu memory. Are having some other soft while rendering. Chrome can consume a lot of ram and vram

[philmaron]

system has 128gb ram, gpu 10gb.

The scene shows it uses 2.9gb vram and claims 5.7 are available, from second frame on it is 1.7gb free, sill 2.9gb used. Thats odd, no?

[aoktar]

OK so share some data with me to show crashes.
Screenshot/_bugreport.zip/console outputs

[philmaron]

OK so share some data with me to show crashes.
Screenshot/_bugreport.zip/console outputs

I will, yet no crashes occur since I changed the delay to 60 seconds. What happens now is that every frames takes longer than the one before, unless I restart the rendering.

Frame 1: 49 Seconds
...
Frame 949: 2 Minutes 50 Seconds
- Stopping rendering manually, starting again at 949 -
Frame 949: 49 Seconds

Weird I think. Should I let something render like that and send you the log aswell?

[aoktar]

OK so share some data with me to show crashes.
Screenshot/_bugreport.zip/console outputs

I will, yet no crashes occur since I changed the delay to 60 seconds. What happens now is that every frames takes longer than the one before, unless I restart the rendering.

Frame 1: 49 Seconds
...
Frame 949: 2 Minutes 50 Seconds
- Stopping rendering manually, starting again at 949 -
Frame 949: 49 Seconds

Weird I think. Should I let something render like that and send you the log aswell?

take look for render statistics for the frames. Check where they spend time and compare render speed

[philmaron]

take look for render statistics for the frames. Check where they spend time and compare render speed

It seems to be "Start Rendering" which takes more and more time. In this scene I have 15 seconds for the 2nd frame, and 1 minute for the 100th frame, 1:42 150th frame... c4d and Log attached. The problem does occurs with every scene right now, but this is very good example.

[aoktar]

Sounds like a hardware stability issue. My render is going consistent. Can you post a screenshot with PV? I see long scene creation times in your log, about 85 secs. Mine is 5 sec. It's very strange.

[jayroth2020]

Hi, you also have Static Noise enabled with the AI Denoiser. You should disable Static Noise, as the AI Denoiser cannot properly work with that function enabled.

[philmaron]

Sounds like a hardware stability issue. My render is going consistent. Can you post a screenshot with PV? I see long scene creation times in your log, about 85 secs. Mine is 5 sec. It's very strange.

Right now, I cant, but I tested something.
I reduced the TdrDelay back to 10 seconds, as I felt there might be a connection.
First frame 40 seconds, 300th frame 5 minutes and when I revisited the machine, all was stuck and crashed before I could make a screenshot. The log is attached. Anything else to see there? I asks to check render statistics, is there a way to reconstruct them? 13:02 was the time when I interacted with the PC again.
The gtx 3080 is now missing from my list of GPUs, only 3 1080s showing up in settings. If you mention stability of hardware, my question would be what to do. Until a few days ago, all worked fine, also with this scene. Should I try every gpu on its own? rollback drivers, change order on the motherboard etc.?