CUDA error 719 on device *: unspecified launch failure

Forums: CUDA error 719 on device *: unspecified launch failure
VIP Information, news and announcements regarding new Octane Render commercial products and releases.

Re: CUDA error 719 on device *: unspecified launch failure

Postby nuno1980 » Thu Jan 12, 2017 11:46 pm

nuno1980 Thu Jan 12, 2017 11:46 pm
@teeshiiddo:
What are your 2 videocards instabled (device 3 and 4 as error 719)? Have you any EVGA GTX 780 Ti Classified (my same issue - HERE)? ;)
NOTE: I'm sorry for bad english due to mute ;)

i7-12700KF
2x16GB RAM@DDR4-3600
MSI PRO Z690-A DDR4
Zotac GF RTX 4090 NEW! <3 :mrgreen:
SSDs OCZ RD400 0.5TB and Crucial 2TB SATA3
HDD 1TB SATA2
LG BD-RE BH16NS40
PSU 1kW
CRT 21" Sony E530 :D
nuno1980
Licensed Customer
Licensed Customer
 
Posts: 728
Joined: Sat Dec 18, 2010 10:04 pm

Re: CUDA error 719 on device *: unspecified launch failure

Postby zoppo » Fri Jan 13, 2017 11:33 am

zoppo Fri Jan 13, 2017 11:33 am
abstrax wrote:
zoppo wrote:I have the same issue from time to time, definitely not a hardware problem.

It only happened after I had updated from 3.0.4.5 to 3.0.5.1

Could you try downgrading to 3.04.5 again and test again? If the problem goes away, could you then upgrade to 3.05.x again and check if the problem comes back? If it does, could you send us the scene plus some instructions how to break CUDA?


I am in the middle of two projects don't have the time atm, sorry. It would be quite a hassle too, because my render slaves are not connected to the internet by default. So I have to switch them back and forth when installing a new OC version.
Maybe at the weekend.

Yesterday I encountered another strange crash: I see all 3 clients in the C4D picture viewer . The onscreen info shows that one or two of them are not rendering, but the clients' standalone windows do not show an error. When checking via GPU-Z I see that indeed the graphic cards are idle.
C4D 2023 | Win10
User avatar
zoppo
Licensed Customer
Licensed Customer
 
Posts: 298
Joined: Wed Dec 09, 2015 10:37 am
Location: München

Re: CUDA error 719 on device *: unspecified launch failure

Postby teeshiiddo » Fri Jan 13, 2017 12:03 pm

teeshiiddo Fri Jan 13, 2017 12:03 pm
nuno1980 wrote:@teeshiiddo:
What are your 2 videocards instabled (device 3 and 4 as error 719)? Have you any EVGA GTX 780 Ti Classified (my same issue - HERE)? ;)


I have 5x 780ti, 2x are OC version, the others standard (3x EVGA, 2x Nvidia).

I truncated the log on the first page, eventually all the devices failed with the same code. How do you isolate a device number to each GPU? All use Hynix memory.
Asus X99 10G WS | Windows 10.0 | 6x GTX 1080 Ti + 2x 2080Ti | i7-6850K CPU @ 3.60GHz | 32GB RAM
teeshiiddo
Licensed Customer
Licensed Customer
 
Posts: 40
Joined: Tue Oct 11, 2016 9:29 am

Re: CUDA error 719 on device *: unspecified launch failure

Postby teeshiiddo » Fri Jan 13, 2017 12:12 pm

teeshiiddo Fri Jan 13, 2017 12:12 pm
abstrax wrote:
zoppo wrote:I have the same issue from time to time, definitely not a hardware problem.

It only happened after I had updated from 3.0.4.5 to 3.0.5.1

Could you try downgrading to 3.04.5 again and test again? If the problem goes away, could you then upgrade to 3.05.x again and check if the problem comes back? If it does, could you send us the scene plus some instructions how to break CUDA?


For me at least I don't think the issue is version related. It has been on going 4-5 months.

I would be great if Otoy could find a way to recover from these errors automatically. Like I mentioned in an earlier post I now use Deadline render manager to restart C4D command line when it detects a render error. Sometimes it will report 20 errors in 12 hours, other times 0. It is very frustrating.

One plus point I'm still about to work in C4D GUI with octane while Deadline renders in the background. It would be great if Octane supported multiple instances natively. Also allowing Deadline two instances per node, meaning C4D could mesh one frame while octane renders another. Meshing/preparing often takes longer than the render.
Asus X99 10G WS | Windows 10.0 | 6x GTX 1080 Ti + 2x 2080Ti | i7-6850K CPU @ 3.60GHz | 32GB RAM
teeshiiddo
Licensed Customer
Licensed Customer
 
Posts: 40
Joined: Tue Oct 11, 2016 9:29 am

Re: CUDA error 719 on device *: unspecified launch failure

Postby nuno1980 » Sat Jan 14, 2017 3:27 pm

nuno1980 Sat Jan 14, 2017 3:27 pm
teeshiiddo wrote:I have 5x 780ti, 2x are OC version, the others standard (3x EVGA, 2x Nvidia).

I truncated the log on the first page, eventually all the devices failed with the same code. How do you isolate a device number to each GPU? All use Hynix memory.
Devices 3 and 4 = your 2 videocards with "EVGA OC version"? If "yes" then try to disable these 2. ;)
What's EVGA OC version? SC, FTW or Classified...?

Hynix memory issue. yeah. :)
NOTE: I'm sorry for bad english due to mute ;)

i7-12700KF
2x16GB RAM@DDR4-3600
MSI PRO Z690-A DDR4
Zotac GF RTX 4090 NEW! <3 :mrgreen:
SSDs OCZ RD400 0.5TB and Crucial 2TB SATA3
HDD 1TB SATA2
LG BD-RE BH16NS40
PSU 1kW
CRT 21" Sony E530 :D
nuno1980
Licensed Customer
Licensed Customer
 
Posts: 728
Joined: Sat Dec 18, 2010 10:04 pm

Re: CUDA error 719 on device *: unspecified launch failure

Postby aoktar » Sat Jan 14, 2017 3:34 pm

aoktar Sat Jan 14, 2017 3:34 pm
teeshiiddo wrote:One plus point I'm still about to work in C4D GUI with octane while Deadline renders in the background. It would be great if Octane supported multiple instances natively. Also allowing Deadline two instances per node, meaning C4D could mesh one frame while octane renders another. Meshing/preparing often takes longer than the render.

You can run multi-C4D's and run one octane on each one.
Octane For Cinema 4D developer / 3d generalist

3930k / 16gb / 780ti + 1070/1080 / psu 1600w / numerous hw
User avatar
aoktar
Octane Plugin Developer
Octane Plugin Developer
 
Posts: 15969
Joined: Tue Mar 23, 2010 8:28 pm
Location: Türkiye

Re: CUDA error 719 on device *: unspecified launch failure

Postby jang2235 » Mon Jan 16, 2017 1:15 am

jang2235 Mon Jan 16, 2017 1:15 am
Are you using data from a version earlier than 3.04.3?

Is not the data you created in the old version?
jang2235
Licensed Customer
Licensed Customer
 
Posts: 155
Joined: Tue Jun 17, 2014 2:04 am

Re: CUDA error 719 on device *: unspecified launch failure

Postby zoppo » Mon Jan 16, 2017 6:33 pm

zoppo Mon Jan 16, 2017 6:33 pm
This morning I installed 3.05.03 and up to now no crash - no CUDA error, no "silent" crashing where the SA window showed no error although the cards weren't rendering.
For testing purposes I rendered two scenes that did crash one or two of the three clients - no crash with 3.05.03 (*knocks on wood*).
C4D 2023 | Win10
User avatar
zoppo
Licensed Customer
Licensed Customer
 
Posts: 298
Joined: Wed Dec 09, 2015 10:37 am
Location: München
Previous

Return to Commercial Product News & Releases (Download here)


Who is online

Users browsing this forum: No registered users and 9 guests

Fri Apr 26, 2024 3:29 pm [ UTC ]