Skip to content

Commit

Permalink
docs: tweaks for multi-backend preview release prep
Browse files Browse the repository at this point in the history
  • Loading branch information
Titus-von-Koeller committed Aug 26, 2024
1 parent 6bef412 commit 2a8cc8d
Showing 1 changed file with 14 additions and 3 deletions.
17 changes: 14 additions & 3 deletions docs/source/installation.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -134,14 +134,23 @@ export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/YOUR_USERNAME/local/cuda-11.7

3. Now when you launch bitsandbytes with these environment variables, the PyTorch CUDA version is overridden by the new CUDA version (in this example, version 11.7) and a different bitsandbytes library is loaded.

## Multi-backend preview release compilation[[multi-backend]]
## Multi-backend[[multi-backend]]

> [!TIP]
> This functionality is currently in preview and therefore not yet production-ready!
Please follow these steps to install bitsandbytes with device-specific backend support other than CUDA:

### Pip install the pre-built wheel (recommended for most)

WIP (will be added in the coming days)

### Compilation

<hfoptions id="backend">
<hfoption id="AMD ROCm">

### AMD GPU
#### AMD GPU

bitsandbytes is fully supported from ROCm 6.1 onwards (currently in alpha release).

Expand Down Expand Up @@ -179,7 +188,7 @@ pip install -e . # `-e` for "editable" install, when developing BNB (otherwise
</hfoption>
<hfoption id="Intel CPU + GPU">

### Intel CPU
#### Intel CPU

> [!TIP]
> Intel CPU backend only supports building from source; for now, please follow the instructions below.
Expand All @@ -200,6 +209,8 @@ pip install -e . # `-e` for "editable" install, when developing BNB (otherwise
</hfoption>
<hfoption id="Apple Silicon (MPS)">

#### Apple Silicon

WIP

</hfoption>
Expand Down

0 comments on commit 2a8cc8d

Please sign in to comment.