is bitsandbytes>=0.43.3 support A10?

[dukai289]

Feature request

I have a server with A1 GPU and the following configuration:
OS: CentOS Linux 7 (Core)
NVIDIA-SMI 550.144.03
CUDA Version: 12.4
manylinux_2_17_x86_64
torch == 2.6

But I got an error when installing unsloth:
ERROR: Could not find a version that satisfies the requirement bitsandbytes>=0.43.3; extra == "colab-new" (from unsloth[colab-new]) (from versions: 0.31.8, 0.32.0, 0.32.1, 0.32.2, 0.32.3, 0.33.0, 0.33.1, 0.34.0, 0.35.0, 0.35.1, 0.35.2, 0.35.3, 0.35.4, 0.36.0, 0.36.0.post1, 0.36.0.post2, 0.37.0, 0.37.1, 0.37.2, 0.38.0, 0.38.0.post1, 0.38.0.post2, 0.38.1, 0.39.0, 0.39.1, 0.40.0, 0.40.0.post1, 0.40.0.post2, 0.40.0.post3, 0.40.0.post4, 0.40.1, 0.40.1.post1, 0.40.2, 0.41.0, 0.41.1, 0.41.2, 0.41.2.post1, 0.41.2.post2, 0.41.3, 0.41.3.post1, 0.41.3.post2, 0.42.0)
ERROR: No matching distribution found for bitsandbytes>=0.43.3; extra == "colab-new"

I want to know, is it because bitsandbytes>=0.43.3 does not support A10, or is there some other reason that causes this problem?

Motivation

to discuss

Your contribution

sorry,

[matthewdouglas]

We do support the NVIDIA A10. In this particular situation, the issue is that we do not provide official support for CentOS 7 (glibc 2.17). Our wheels are build with manylinux2_24 as the minimum requirement.

Copying from #1476:

Hi there. CentOS is not supported by our binary wheels as it is past end of life.
You may have some luck building from source, but we are not able to provide future source compatibility guarantees or support for it.