Skip to content

Commit

Permalink
cleanup docs-build breaking install instructs
Browse files Browse the repository at this point in the history
  • Loading branch information
Titus-von-Koeller committed Jun 6, 2024
1 parent 36fe1a0 commit a51863e
Show file tree
Hide file tree
Showing 2 changed files with 26 additions and 46 deletions.
26 changes: 26 additions & 0 deletions docs/source/installation.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -91,6 +91,32 @@ Big thanks to [wkpark](https://github.com/wkpark), [Jamezo97](https://github.com
</hfoption>
</hfoptions>

## Multi-backend preview release (+ compilation)

Please follow these steps to install bitsandbytes with device-specific backend support other than CUDA:

<hfoptions id="Alternative backend">
<hfoption id="AMD ROCm">

For a ROCm specific install:

```bash
git clone --depth 1 https://github.com/TimDettmers/bitsandbytes.git && cd bitsandbytes/
git checkout multi-backend-refactor

# Install dependencies
apt install hipblaslt
pip install -r requirements-dev.txt

# Compile & install
cmake -DCOMPUTE_BACKEND=hip -S . #Use -DBNB_ROCM_ARCH="gfx90a;gfx942" to target specific gpu arch
make
pip install .
```

<hfoption>
</hfoptions>

## PyTorch CUDA versions

Some bitsandbytes features may need a newer CUDA version than the one currently supported by PyTorch binaries from Conda and pip. In this case, you should follow these instructions to load a precompiled bitsandbytes binary.
Expand Down
46 changes: 0 additions & 46 deletions docs/source/rocm_installation.mdx

This file was deleted.

0 comments on commit a51863e

Please sign in to comment.