help: CUDA error 700

[cristiangiro]

Hi,
since one week, out of the blue i'm having octane live viewer giving me errors after few minutes it's loaded.
I looked for some answers on the forum, and as i read i tried to update the bios, fresh installed and downgraded my card driver, tried to use an old octane version, but i still get the error after few minutes
now i'm running on c4d r19.053 and octane 3.07-r2, nvidia driver 398.36 (i have 2 x 1080ti)
i really don't know what to do, any help?
thanks in advance


Loaded Octane DLL:OctaneRender 3.08.2 version:3080200
Octane Render for Cinema 4D 3.08.2-R2.1 built for:190 C4D vers:19053
Octane Render SDK version: 3.08.2


=============================================================

--------------------------- EXPORT LOG ---------------------------
Export materials time= 178553.472 ms
Collect objects time= 32.774 ms
Mesh creation time = 2126.038 ms.
OCT:Tried to access pin via an invalid ID P_TRANSFORM (243)
OCT:Tried to access null node pin
OCT:Tried to access pin via an invalid ID P_TRANSFORM (243)
OCT:Tried to access null node pin
Total export Time = 180782.363 ms
VRAM used/free/max:7.855Gb/1.036Gb/11Gb Out-of-core used:3.902Gb total used RAM:39.811Gb
OCT:CUDA error 700 on device 1: an illegal memory access was encountered
OCT: -> kernel execution failed(kernel25)
OCT:CUDA error 700 on device 1: an illegal memory access was encountered
OCT: -> failed to launch kernel(kernel34)
OCT:device 1: path tracing kernel failed
----------------------------------------------------------------------------------------
<<< Render failure detected!!! >>>
Please check render statistics to solve the problem.
MB:0/0 ST/MOV:0/19 Nodes:391 Tris:3.5m DispTris:137k Hairs:0 Meshes:22
Device:0 TotMem:11Gb rtData:604Mb film:110Mb geo:587Mb node:18Kb tex:6.583Gb unavailable:2.324Gb temperature:64
Device:1 TotMem:11Gb rtData:604Mb film:110Mb geo:587Mb node:18Kb tex:6.583Gb unavailable:2.067Gb temperature:58
OCT:Failed to free page-locked memory
OCT:Failed to free page-locked memory
OCT:Failed to free page-locked memory
OCT:Failed to free page-locked memory
OCT:Failed to free page-locked memory
OCT:Failed to free page-locked memory
OCT:Failed to free page-locked memory
OCT:Failed to free page-locked memory
OCT:Failed to free page-locked memory
OCT:Failed to free page-locked memory
OCT:Failed to free page-locked memory
OCT:Failed to free page-locked memory
OCT:Failed to free page-locked memory
OCT:Failed to free page-locked memory
OCT:CUDA error 700 on device 0: an illegal memory access was encountered
OCT: -> failed to copy memory to device.
OCT:device 0: failed to upload data texture 23 of context 1
OCT:CUDA error 700 on device 0: an illegal memory access was encountered
OCT: -> failed to deallocate device memory
OCT:CUDA error 700 on device 0: an illegal memory access was encountered
OCT: -> could not get memory info
OCT:CUDA error 700 on device 0: an illegal memory access was encountered
OCT: -> failed to load symbol data to the device(kernel data)
OCT:device 0: preview failed
OCT:CUDA error 700 on device 0: an illegal memory access was encountered
OCT: -> failed to set texture format(__data24__)
OCT:CUDA error 700 on device 0: an illegal memory access was encountered
OCT: -> failed to set texture format(__data26__)
OCT:CUDA error 700 on device 0: an illegal memory access was encountered
OCT: -> failed to deallocate device memory
OCT:CUDA error 700 on device 0: an illegal memory access was encountered
OCT: -> could not get memory info
OCT:CUDA error 700 on device 0: an illegal memory access was encountered
OCT: -> failed to load symbol data to the device(const11)
OCT:device 0: failed to upload imager params

[aoktar]

VRAM used/free/max:7.855Gb/1.036Gb/11Gb Out-of-core used:3.902Gb total used RAM:39.811Gb

Here I see that you have a low free VRAM. Do you open/work another software as AE, PS, Chrome, etc at same time of render session?

[cristiangiro]

yes, just chrome actually, i close everything else

[aoktar]

Watch your free VRAM while rendering. Sometimes it makes peek for transfering buffers or so. It shows a VRAM error in log.
And it's clear that you have very high export time. It's 180782.363 ms = 180.78 seconds. It's very high. Your material export time is much exposive. 178.5 seconds. What do you have so much?

[cristiangiro]

I always have very dense geometry, since i only render images i guessed having a lot of triangles would not be a problem,
how should i optimise the scene to have a shorter export time and less triangles?
cheers

[cristiangiro]

Also using 8k textures (which i am using) may get in the way for a long export, right?

[aoktar]

I always have very dense geometry, since i only render images i guessed having a lot of triangles would not be a problem,
how should i optimise the scene to have a shorter export time and less triangles?
cheers

I may be a problem too. in V3 geometries should fit to VRAM. Be aware of triangle count differences on LV against PV. Check how many triangles in LiveViewer and PictureViewer. Do this by deleting all materials if you cant render in case.

[aoktar]

Also using 8k textures (which i am using) may get in the way for a long export, right?

I suppose you're using some C4D shaders like Layer/Noise/etc... right?

[cristiangiro]

not at all, i'm using exported substance painter textures branched in the basic octane channels, i never use layers or even c4d noises on octane materials..

what do you mean with:

Do this by deleting all materials if you cant render in case.

thanks!!

[Kalua]

I have a similar problem:
The difference is I'm not loading a single mesh or material in the scene... Any thoughts...?
It started yestarday, since them I cant render anything... standalone or plugin...
Already tried to reinstal drivers ...

Started logging on 21.08.18 14:43:38

OctaneRender 3.08.3 (3080300)

CUDA error 700 on device 2: an illegal memory access was encountered
-> kernel execution failed(kernel25)
CUDA error 700 on device 2: an illegal memory access was encountered
-> failed to launch kernel(kernel26)
device 2: direct light kernel failed
CUDA error 700 on device 0: an illegal memory access was encountered
CUDA error 700 on device 1: an illegal memory access was encountered
-> failed to deallocate pinned memory
-> could not get memory info
CUDA error 700 on device 0: an illegal memory access was encountered
CUDA error 700 on device 1: an illegal memory access was encountered
-> could not get memory info
-> failed to load symbol data to the device(deep_data)
CUDA error 700 on device 0: an illegal memory access was encountered
device 1: failed to upload the deep params
-> failed to allocate pinned memory
device 0: failed to allocate tonemap result buffer
CUDA error 700 on device 2: an illegal memory access was encountered
-> failed to load symbol data to the device(kernel data)
device 2: picking failed
CUDA error 700 on device 2: an illegal memory access was encountered
-> failed to load symbol data to the device(kernel data)
device 2: picking failed
CUDA error 700 on device 2: an illegal memory access was encountered
-> failed to load symbol data to the device(kernel data)
device 2: picking failed
CUDA error 700 on device 2: an illegal memory access was encountered
-> failed to load symbol data to the device(kernel data)
device 2: picking failed
CUDA error 700 on device 2: an illegal memory access was encountered
-> failed to load symbol data to the device(kernel data)
device 2: picking failed
CUDA error 700 on device 2: an illegal memory access was encountered
-> failed to load symbol data to the device(kernel data)
device 2: picking failed
CUDA error 700 on device 2: an illegal memory access was encountered
-> failed to load symbol data to the device(kernel data)
device 2: picking failed

EDIT:
After making lots of hardware tests I found out its a GPU hardware issue... so one of my 1080s is faulty and doenst render anymore so I had to disconnect it.
Rendering just fine now.