Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add CPU benchmark #1353

Closed
Changes from 1 commit
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
2621e1a
docs: cleanup compilation instrs for multi-backend
Titus-von-Koeller Jul 27, 2024
87f88af
Enable loading prequantized weights with bf16/fp16/fp32 quant_storage…
matthewdouglas Jul 29, 2024
5cc91b1
Bump pytest from 8.3.1 to 8.3.2 in the minor-patch group (#1296)
dependabot[bot] Jul 29, 2024
a96d2f0
Merge branch 'main' into fsdp-load-prequantized
matthewdouglas Jul 29, 2024
3a6911f
Merge pull request #1295 from matthewdouglas/fsdp-load-prequantized
matthewdouglas Jul 29, 2024
b64cbe3
add job to upload wheels to continuous pre-release (#1282)
Titus-von-Koeller Jul 29, 2024
2e03d34
release 0.43.3
Titus-von-Koeller Jul 30, 2024
4be1883
packaging: bump permissions for continuous release step
Titus-von-Koeller Jul 31, 2024
6d714a5
Embedding4bit and Embedding8bit implementation (#1292)
galqiwi Aug 6, 2024
a4875fc
Bugfix: Load correct nocublaslt library variant when BNB_CUDA_VERSION…
matthewdouglas Aug 14, 2024
7476f6b
docs: update rocm installation instructions
Titus-von-Koeller Aug 18, 2024
fe8b3bc
add missing test requirement
Titus-von-Koeller Aug 21, 2024
6ae9859
docs: fix pre-commit instructions
Titus-von-Koeller Aug 21, 2024
a685654
Enable certain CUDA kernels to accept specified cuda stream (#1330)
jeejeelee Aug 22, 2024
432a4f4
Initial support for ppc64le (#1316)
mgiessing Aug 22, 2024
6bef412
Cuda source cleanup , refactor and fixes (#1328)
abhilash1910 Aug 26, 2024
2a8cc8d
docs: tweaks for multi-backend preview release prep
Titus-von-Koeller Aug 26, 2024
d300136
docs: get started on detailed multi-backend guide
Titus-von-Koeller Aug 29, 2024
e467453
actions: update permissions for pr docs publishing
Titus-von-Koeller Aug 30, 2024
17da4f6
Update for VS2022 17.11 compatibility with CUDA < 12.4 (#1341)
matthewdouglas Sep 9, 2024
a0da01e
correct version to next dev after last release
Titus-von-Koeller Sep 11, 2024
c6426ce
Bump the minor-patch group with 3 updates (#1362)
dependabot[bot] Sep 19, 2024
97b112c
Update matplotlib requirement from ~=3.9.1 to ~=3.9.2 in the major gr…
dependabot[bot] Sep 19, 2024
abb0c32
docs: add internal reference to multi-backend guide (#1352)
Titus-von-Koeller Sep 19, 2024
8fc7892
Add `move_to_device` kwarg to the optimizer's `load_state_dict` (#1344)
koute Sep 19, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
docs: add internal reference to multi-backend guide (#1352)
Titus-von-Koeller authored Sep 19, 2024
commit abb0c32a742cba25532bc542c7904a12219e5d15
2 changes: 1 addition & 1 deletion docs/source/installation.mdx
Original file line number Diff line number Diff line change
@@ -137,7 +137,7 @@ export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/YOUR_USERNAME/local/cuda-11.7
## Multi-backend[[multi-backend]]

> [!TIP]
> This functionality is currently in preview and therefore not yet production-ready!
> This functionality is currently in preview and therefore not yet production-ready! Please reference [this guide](./non_cuda_backends) for more in-depth information about the different backends and their current status.

Please follow these steps to install bitsandbytes with device-specific backend support other than CUDA: