Release v44 not available for Mac

[ACMCMC]

System Info

platform: Mac

Reproduction

pip install bitsandbytes

It will install v42 instead of v44.

Then, if you try to load any model with quantization, you will get this error:

ImportError: Using bitsandbytes 4-bit quantization requires the latest version of bitsandbytes: pip install -U bitsandbytes

Expected behavior

Installing v44 shouldn't show any import errors. But it currently does, on Mac systems, as the latest available version for Mac is v42.

Indeed, while v42 had support for all architectures:

---

Built Distribution

bitsandbytes-0.42.0-py3-none-any.whl (105.0 MB view hashes)

Uploaded Jan 8, 2024 Python 3

---

v44 only has support for Windows and Linux:

---

Built Distributions

bitsandbytes-0.44.0-py3-none-win_amd64.whl (121.5 MB view hashes)

Uploaded Sep 24, 2024 Python 3 Windows x86-64

bitsandbytes-0.44.0-py3-none-manylinux_2_24_x86_64.whl (122.4 MB view hashes)

Uploaded Sep 24, 2024 Python 3 manylinux: glibc 2.24+ x86-64

---

[matthewdouglas]

Hi @ACMCMC,
None of the releases are supported on macOS yet. Releases up through 0.42.0 were incorrectly tagged as supporting all platforms, but this was an oversight. Those older wheels only contain x86-64 binaries for Linux.

[ACMCMC]

In that case, I'd propose that Mac users should get a warning, rather than being told to "use the latest version" of something that they can't use at all... 🙏🏻

[steveepreston]

on TPU VM env, im getting same error!

while installed bitsandbytes via pip install -U bitsandbytes, it still throws:

ImportError: Using bitsandbytes 4-bit quantization requires the latest version of bitsandbytes: pip install -U bitsandbytes

[wuhongsheng]

+1

[xring]

+1
got
No matching distribution found for bitsandbytes>=0.43.3
and
pip install bitsandbytes
get version 0.42.0

[nikvin15]

+1

Collecting accelerate==1.0.1 (from -r requirements-gpu.txt (line 1))
  Downloading accelerate-1.0.1-py3-none-any.whl.metadata (19 kB)
ERROR: Could not find a version that satisfies the requirement bitsandbytes==0.44.1 (from versions: 0.31.8, 0.32.0, 0.32.1, 0.32.2, 0.32.3, 0.33.0, 0.33.1, 0.34.0, 0.35.0, 0.35.1, 0.35.2, 0.35.3, 0.35.4, 0.36.0, 0.36.0.post1, 0.36.0.post2, 0.37.0, 0.37.1, 0.37.2, 0.38.0, 0.38.0.post1, 0.38.0.post2, 0.38.1, 0.39.0, 0.39.1, 0.40.0, 0.40.0.post1, 0.40.0.post2, 0.40.0.post3, 0.40.0.post4, 0.40.1, 0.40.1.post1, 0.40.2, 0.41.0, 0.41.1, 0.41.2, 0.41.2.post1, 0.41.2.post2, 0.41.3, 0.41.3.post1, 0.41.3.post2, 0.42.0)
ERROR: No matching distribution found for bitsandbytes==0.44.1

I am on Mac as well Apple M2 Pro

[chenxijunlove]

+1

[matthewdouglas]

Hi everyone,

Please see the discussion here on Apple Silicon support. Bitsandbytes does not currently support macOS, but we're looking for contributions to make that happen!