Is my gpu failing?

droidy001droidy001 Posts: 282

[Is my gpu failing?] Final part of log below

Thanks

 

Edit: 3090 all temps fine just over 7gb of vram in use

 

 

2023-08-03 15:08:54.764 Iray [INFO] - IRAY:RENDER ::   1.0   IRAY   rend progr: Received update to 00625 iterations after 124.291s.
2023-08-03 15:09:02.922 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): Kernel [6] (LightSamplingSr   ) failed after 2.561s
2023-08-03 15:09:02.922 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): the launch timed out and was terminated (while launching CUDA renderer in <internal>:951)
2023-08-03 15:09:02.922 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.11  IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): Failed to launch renderer
2023-08-03 15:09:02.923 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): Device failed while rendering
2023-08-03 15:09:02.923 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [WARNING] - IRAY:RENDER ::   1.6   IRAY   rend warn : CUDA device 0 (NVIDIA GeForce RTX 3090) is no longer available for rendering.
2023-08-03 15:09:02.924 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [WARNING] - IRAY:RENDER ::   1.6   IRAY   rend warn : All available GPUs failed.
2023-08-03 15:09:02.924 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: Fallback to CPU not allowed.
2023-08-03 15:09:02.924 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): the launch timed out and was terminated (while initializing memory buffer)
2023-08-03 15:09:02.924 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: All workers failed: aborting render
2023-08-03 15:09:02.924 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): [Guidance sync] Failed slave device (remaining 0, done 0).
2023-08-03 15:09:02.924 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): the launch timed out and was terminated (while de-allocating memory)
2023-08-03 15:09:02.924 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): the launch timed out and was terminated (while de-allocating memory)
2023-08-03 15:09:02.924 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): the launch timed out and was terminated (while de-allocating memory)
2023-08-03 15:09:02.924 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): the launch timed out and was terminated (while de-allocating memory)
2023-08-03 15:09:02.925 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): the launch timed out and was terminated (while de-allocating memory)
2023-08-03 15:09:02.925 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): the launch timed out and was terminated (while de-allocating memory)
2023-08-03 15:09:02.925 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): the launch timed out and was terminated (while de-allocating memory)
2023-08-03 15:09:02.925 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): the launch timed out and was terminated (while de-allocating memory)
2023-08-03 15:09:02.925 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): the launch timed out and was terminated (while de-allocating memory)
2023-08-03 15:09:02.925 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): the launch timed out and was terminated (while de-allocating memory)
2023-08-03 15:09:02.925 [WARNING] :: ..\..\..\..\..\src\pluginsource\DzIrayRender\dzneuraymgr.cpp(369): Iray [ERROR] - IRAY:RENDER ::   1.6   IRAY   rend error: CUDA device 0 (NVIDIA GeForce RTX 3090): the launch timed out and was terminated (while de-allocating memory)

 

Post edited by Richard Haseltine on

Comments

  • droidy001droidy001 Posts: 282
    edited August 2023

    Seems like it was the undervolt I had on Afterburner.

     

    Edit:Not that. render worked at first then second one failed again

    Post edited by droidy001 on
  • You might want to do a clean reinstall of the driver.

  • frank0314frank0314 Posts: 14,045
    edited August 2023

    I'd suggest the same as Richard and download the driver from Nvidia's site instead of Geforce Experience. You can look it up here. I plugged in the info already, but be sure to check that it's correct

    Post edited by frank0314 on
  • droidy001droidy001 Posts: 282

    Richard Haseltine said:

    You might want to do a clean reinstall of the driver.

    Thanks, I've tried that using ddu and updated to latest but still the same.

     

  • KitsumoKitsumo Posts: 1,215

    I would try the Blender benchmark https://opendata.blender.org/ It uses CUDA/OptiX just like Daz (but doesn't use Iray) so it might help you tell whether it's a DS problem, Iray problem or Nvidia driver problem. It's been a while since I used it in Windows, but I think if you launch it from the command line, you'll be able to see the output as it's running. I don't know if it has an actual debug log.

  • droidy001droidy001 Posts: 282

    Kitsumo said:

    I would try the Blender benchmark https://opendata.blender.org/ It uses CUDA/OptiX just like Daz (but doesn't use Iray) so it might help you tell whether it's a DS problem, Iray problem or Nvidia driver problem. It's been a while since I used it in Windows, but I think if you launch it from the command line, you'll be able to see the output as it's running. I don't know if it has an actual debug log.

    Fearing the worst, the blender benchmark crashed so I downloaded the junkshop file. That rendered fine but it's only a short render so I switched to viewport shading. After maybe a minute of zooming in and out and panning it crashed.

  • TimberWolfTimberWolf Posts: 288
    edited August 2023

    I very much doubt this is a pending GPU failure as you normally get some indication that it's coming other than renders failing part way through; artefacts on the desktop and applications, instant crash when opening a GPU intensive application such as a game. Not always, but mostly. If you do have a GPU about to fail I've never seen symptoms like yours. I could obviously be wrong but this feels more software related.

    Can you push the GPU with a non-rendering application for a while, something like a game or a benchmark like Unigine, and see if the same happens?

    If you can run something else ok your GPU is definitely not failing and it's something related to your OS environment. Reinstall the lot. Even if it crashes then, before you write off the GPU, I'd have a think about a clean reinstall of the OS. It can be a lengthy process and a real pain but if this were my scenario and I'd exhausted driver, tweaks and suggestions that is what I would do. Reinstall the OS, new drivers, install Studio before anything else, connect it to my library and have another crack at it. It takes time but it's a lot cheaper than buying a new GPU and hoping that will fix it.

    Post edited by TimberWolf on
  • PerttiAPerttiA Posts: 10,024

    This stress test has been used when other tests or games have failed to find the problem

    https://www.ocbase.com/
     

  • PetercatPetercat Posts: 2,321

    Check your power supply.
    Set your fans to full-time full speed, and see if you can hear them slow down when rendering begins.

Sign In or Register to comment.