Unable to install CUDA 11.8, driver 525, and cuDNN 8.9 on Ubuntu 22.04 LTS with an A5000 GPU

[tomervazana]

I'm aiming to operationalize the Hailo AI software suite on my Ubuntu 22.04 LTS with an A5000 GPU. Hailo’s platform mandates CUDA 11.8, driver 525, and cuDNN 8.9. However, apt consistently installs the 535 driver and CUDA 12.2 (as per nvidia-smi). Attempts to manually revert to CUDA 11.8 resulted in a non-functional nvidia-smi.

My objective is to either successfully downgrade or spin up an alternate environment that aligns precisely with Hailo’s specs. Any insight or proven methodology on safely maintaining multiple driver/CUDA configurations or pinning specific package versions would be greatly appreciated. I'm looking for a stable path to meet immediate project milestones without compromising broader system integrity.

Thank you in advance for your recommendations and support!

[leofang]

Hi, sorry for late reply. You should be able to use any driver version newer than CUDA 11.8/r525, but still stay on an older CUDA version. If you can use conda, conda create -n my_new_env -c conda-forge cudnn=8.9 cuda-version=11.8 should work, assuming you don't need to build other dependencies from source. You just need to install the driver separately.