Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot install unsloth with bitsandbytes problem #1476

Closed
JJS-L opened this issue Jan 18, 2025 · 2 comments
Closed

Cannot install unsloth with bitsandbytes problem #1476

JJS-L opened this issue Jan 18, 2025 · 2 comments
Labels
wontfix This will not be worked on

Comments

@JJS-L
Copy link

JJS-L commented Jan 18, 2025

Centos x86_64

Python 3.11.11

torch 2.5.1

cuda 12.1

I want to install unsloth in Linux, but I cannot download directly from GitHub,I use the zip to setup unsloth .Here, I'm stuck with the problem, I typed in the following command.

conda create --name unsloth_env
python=3.11
pytorch-cuda=12.1
pytorch cudatoolkit xformers -c pytorch -c nvidia -c xformers
-y
conda activate unsloth_env

where, I cd /unsloth_main #which is the unzipped zip file

pip install ".[cu121-torch250]

Then, the following error occurs
@

Processing /home/.../unsloth-main
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
INFO: pip is looking at multiple versions of unsloth[cu121-torch250] to determine which version is compatible with other requirements. This could take a while.
ERROR: Could not find a version that satisfies the requirement bitsandbytes>=0.43.3; extra == "cu121-torch250" (from unsloth[cu121-torch250]) (from versions: 0.31.8, 0.32.0, 0.32.1, 0.32.2, 0.32.3, 0.33.0, 0.33.1, 0.34.0, 0.35.0, 0.35.1, 0.35.2, 0.35.3, 0.35.4, 0.36.0, 0.36.0.post1, 0.36.0.post2, 0.37.0, 0.37.1, 0.37.2, 0.38.0, 0.38.0.post1, 0.38.0.post2, 0.38.1, 0.39.0, 0.39.1, 0.40.0, 0.40.0.post1, 0.40.0.post2, 0.40.0.post3, 0.40.0.post4, 0.40.1, 0.40.1.post1, 0.40.2, 0.41.0, 0.41.1, 0.41.2, 0.41.2.post1, 0.41.2.post2, 0.41.3, 0.41.3.post1, 0.41.3.post2, 0.42.0)
ERROR: No matching distribution found for bitsandbytes>=0.43.3; extra == "cu121-torch250"

@
And I'm taking the update the Bitsangbytes from 0.42 to 0.44.2, but I'm in trouble again.

ERROR: bitsandbytes-0.44.2.dev0-py3-none-manylinux_2_24_x86_64.whl is not a supported wheel on this platform.

I don't konw how to solve

@matthewdouglas
Copy link
Member

Hi there. CentOS is not supported by our binary wheels as it is past end of life.
You may have some luck building from source, but we are not able to provide future source compatibility guarantees or support for it.

@matthewdouglas matthewdouglas added the wontfix This will not be worked on label Jan 22, 2025
@JJS-L
Copy link
Author

JJS-L commented Jan 25, 2025

Hi there. CentOS is not supported by our binary wheels as it is past end of life. You may have some luck building from source, but we are not able to provide future source compatibility guarantees or support for it.

Oh! Thank you so much for responding to my quesion. I seem to have successfully installed unsloth in a conda environment without reporting this problem, but I have other problems. I still have the problem when I install it in another environment and I don't know why this is

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
wontfix This will not be worked on
Projects
None yet
Development

No branches or pull requests

2 participants