cuda set up error

[Lastpawn6280]

System Info

window11, 4060ti, AMD64, CUDA 11.8, python 3.10.6

Reproduction

venv "C:\Users\User\stable-diffusion-webui\venv\Scripts\Python.exe"
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: v1.10.1
Commit hash: 82a973c04367123ae98bd9abdf80d9eda9b910e2
Launching Web UI with arguments: --skip-install
C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cextension.py:101: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {WindowsPath('tmp/restart')}
warn(msg)
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching /usr/local/cuda/lib64...
C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cextension.py:101: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {WindowsPath('/usr/local/cuda/lib64')}
warn(msg)
CUDA SETUP: WARNING! libcuda.so not found! Do you have a CUDA driver installed? If you are on a cluster, make sure you are on a CUDA machine!
C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cextension.py:101: UserWarning: WARNING: No libcudart.so found! Install CUDA or the cudatoolkit package (anaconda)!
warn(msg)
C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cextension.py:101: UserWarning: WARNING: No GPU detected! Check your CUDA paths. Proceeding to load CPU-only library...
warn(msg)
CUDA SETUP: Loading binary C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.so...
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching /usr/local/cuda/lib64...
CUDA SETUP: WARNING! libcuda.so not found! Do you have a CUDA driver installed? If you are on a cluster, make sure you are on a CUDA machine!
CUDA SETUP: Loading binary C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.so...
CUDA SETUP: Problem: The main issue seems to be that the main CUDA library was not detected.
CUDA SETUP: Solution 1): Your paths are probably not up-to-date. You can update them via: sudo ldconfig.
CUDA SETUP: Solution 2): If you do not have sudo rights, you can do the following:
CUDA SETUP: Solution 2a): Find the cuda library via: find / -name libcuda.so 2>/dev/null
CUDA SETUP: Solution 2b): Once the library is found add it to the LD_LIBRARY_PATH: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:FOUND_PATH_FROM_2a
CUDA SETUP: Solution 2c): For a permanent solution add the export from 2b into your .bashrc file, located at ~/.bashrc
Traceback (most recent call last):
File "C:\Users\User\stable-diffusion-webui\launch.py", line 48, in
main()
File "C:\Users\User\stable-diffusion-webui\launch.py", line 44, in main
start()
File "C:\Users\User\stable-diffusion-webui\modules\launch_utils.py", line 465, in start
import webui
File "C:\Users\User\stable-diffusion-webui\webui.py", line 13, in
initialize.imports()
File "C:\Users\User\stable-diffusion-webui\modules\initialize.py", line 26, in imports
from modules import paths, timer, import_hook, errors # noqa: F401
File "C:\Users\User\stable-diffusion-webui\modules\paths.py", line 60, in
import sgm # noqa: F401
File "C:\Users\User\stable-diffusion-webui\repositories\generative-models\sgm_init_.py", line 1, in
from .models import AutoencodingEngine, DiffusionEngine
File "C:\Users\User\stable-diffusion-webui\repositories\generative-models\sgm\models_init_.py", line 1, in
from .autoencoder import AutoencodingEngine
File "C:\Users\User\stable-diffusion-webui\repositories\generative-models\sgm\models\autoencoder.py", line 12, in
from ..modules.diffusionmodules.model import Decoder, Encoder
File "C:\Users\User\stable-diffusion-webui\repositories\generative-models\sgm\modules_init_.py", line 1, in
from .encoders.modules import GeneralConditioner
File "C:\Users\User\stable-diffusion-webui\repositories\generative-models\sgm\modules\encoders\modules.py", line 5, in
import kornia
File "C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\kornia_init_.py", line 11, in
from . import augmentation, color, contrib, core, enhance, feature, io, losses, metrics, morphology, tracking, utils, x
File "C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\kornia\x_init_.py", line 2, in
from .trainer import Trainer
File "C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\kornia\x\trainer.py", line 11, in
from accelerate import Accelerator
File "C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\accelerate_init_.py", line 3, in
from .accelerator import Accelerator
File "C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\accelerate\accelerator.py", line 35, in
from .checkpointing import load_accelerator_state, load_custom_state, save_accelerator_state, save_custom_state
File "C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\accelerate\checkpointing.py", line 24, in
from .utils import (
File "C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\accelerate\utils_init_.py", line 131, in
from .bnb import has_4bit_bnb_layers, load_and_quantize_model
File "C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\accelerate\utils\bnb.py", line 42, in
import bitsandbytes as bnb
File "C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes_init_.py", line 6, in
from .autograd._functions import (
File "C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\autograd_functions.py", line 5, in
import bitsandbytes.functional as F
File "C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\functional.py", line 13, in
from .cextension import COMPILED_WITH_CUDA, lib
File "C:\Users\User\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\cextension.py", line 118, in
raise RuntimeError('''
RuntimeError:
CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs aboveto fix your environment!
If you cannot find any issues and suspect a bug, please open an issue with detals about your environment:
https://github.com/TimDettmers/bitsandbytes/issues
계속하려면 아무 키나 누르십시오 . . .

Expected behavior

i test few version, 0.35.4, 0.38.1, and the lastest ver.
despite all the test, not working, can't find Cuda library...
even import under python, "import bitsandbytes" does not working, error about Cuda setup part.
what can i do for this?

[GoulartNogueira]

In my case, this worked fine:

#1315 (comment)

pip uninstall bitsandbytes
to uninstall, then:
pip install --upgrade "bitsandbytes>=0.43.2"

[Lastpawn6280]

ok. i can't find any more issue on bitsandbytes...
maybe other things collision.
thanks for help.