Iray fails mid-render

Xen2k

Hello,

I'm getting kinda desperate with Iray rendering fails for no understandable reason. My GPU has 24 GB VRAM and fits the scene without issues. It starts rendering but at a certain point it stops. If I try to re-render it results in a black image and I have to restart DAZ completely. The log file shows the below errors. 

Has anyone an idea what may cause this?

System info:
DAZ version. 4.20.0.17
Nvidia driver 512.96 (Studio version)

 

2022-06-18 22:26:48.080 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : Device statistics:
2022-06-18 22:26:48.080 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend info : CUDA device 0 (NVIDIA GeForce RTX 3090): 897 iterations, 4.788s init, 250.833s render
2022-06-18 22:26:48.081 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal instruction was encountered (while de-allocating memory)
2022-06-18 22:26:48.081 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal instruction was encountered (while de-allocating memory)
2022-06-18 22:26:48.081 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal instruction was encountered (while de-allocating memory)
2022-06-18 22:26:48.081 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal instruction was encountered (while de-allocating memory)
2022-06-18 22:26:48.081 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal instruction was encountered (while de-allocating memory)
2022-06-18 22:26:48.081 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal instruction was encountered (while de-allocating memory)
2022-06-18 22:26:48.081 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.0   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): an illegal instruction was encountered (while de-allocating memory)
2022-06-18 22:26:48.170 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error synching on OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.170 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error destroying OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.170 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.26  IRAY   rend error: optixPipelineDestroy(pop_ptr(m_pipeline)) failed: CUDA error
2022-06-18 22:26:48.170 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error synching on OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.171 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error destroying OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.171 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.26  IRAY   rend error: optixPipelineDestroy(pop_ptr(m_pipeline)) failed: CUDA error
2022-06-18 22:26:48.171 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error synching on OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.171 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error destroying OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.171 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.26  IRAY   rend error: optixPipelineDestroy(pop_ptr(m_pipeline)) failed: CUDA error
2022-06-18 22:26:48.171 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error synching on OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.171 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error destroying OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.171 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.26  IRAY   rend error: optixPipelineDestroy(pop_ptr(m_pipeline)) failed: CUDA error
2022-06-18 22:26:48.171 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error synching on OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.171 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error destroying OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.171 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.26  IRAY   rend error: optixPipelineDestroy(pop_ptr(m_pipeline)) failed: CUDA error
2022-06-18 22:26:48.171 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error synching on OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.172 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error destroying OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.172 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.26  IRAY   rend error: optixPipelineDestroy(pop_ptr(m_pipeline)) failed: CUDA error
2022-06-18 22:26:48.172 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error synching on OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.172 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error destroying OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.172 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.26  IRAY   rend error: optixPipelineDestroy(pop_ptr(m_pipeline)) failed: CUDA error
2022-06-18 22:26:48.172 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error synching on OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.172 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error destroying OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.172 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.26  IRAY   rend error: optixPipelineDestroy(pop_ptr(m_pipeline)) failed: CUDA error
2022-06-18 22:26:48.172 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error synching on OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.172 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error destroying OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.172 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.26  IRAY   rend error: optixPipelineDestroy(pop_ptr(m_pipeline)) failed: CUDA error
2022-06-18 22:26:48.172 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error synching on OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.173 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error destroying OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.173 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.26  IRAY   rend error: optixPipelineDestroy(pop_ptr(m_pipeline)) failed: CUDA error
2022-06-18 22:26:48.173 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error synching on OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.173 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error destroying OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.173 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.26  IRAY   rend error: optixPipelineDestroy(pop_ptr(m_pipeline)) failed: CUDA error
2022-06-18 22:26:48.173 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error synching on OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.173 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - OPTX:RENDER ::   1.26  OPTX   rend error: Error destroying OptixPipeline event (CUDA error string: an illegal instruction was encountered, CUDA error code: 715)
2022-06-18 22:26:48.173 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(367): Iray [ERROR] - IRAY:RENDER ::   1.26  IRAY   rend error: optixPipelineDestroy(pop_ptr(m_pipeline)) failed: CUDA error

Xen2k

Okay, maybe I have an answer to my own question:

I'm usually undervolting my graphics card (mainly to reduce the temperatures and save some energy in the process).
When I reset the volting to factory standard I did another render-test with following observations:

1) the render completed 100%
2) the voltage of the GPU (monitored in GPU-Z) was lower at the beginning of the render (0.9 V). It made then made a jump to 1.06 V (=max. of the factory settings).

I'm now fine-tuning my undervolting a bit. Hopefully this will solve the issue completely.