Currently, the bitsandbytes-intel reply on bitsandbytes which contains many cuda libs. The bitsandbytes binding cuda pytorch so it will uninstall our cpu/xpu version pytorch and introduce a lot of cuda libs. @matthewdouglas plans to release a bitsandbytes-base lib to solve it. We can track in this issue.