-
Notifications
You must be signed in to change notification settings - Fork 652
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
add CPU benchmark #1353
Closed
jiqing-feng
wants to merge
25
commits into
bitsandbytes-foundation:multi-backend-refactor
from
jiqing-feng:cpu_doc
Closed
add CPU benchmark #1353
jiqing-feng
wants to merge
25
commits into
bitsandbytes-foundation:multi-backend-refactor
from
jiqing-feng:cpu_doc
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…s-foundation#1296) Bumps the minor-patch group with 1 update: [pytest](https://github.com/pytest-dev/pytest). Updates `pytest` from 8.3.1 to 8.3.2 - [Release notes](https://github.com/pytest-dev/pytest/releases) - [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst) - [Commits](pytest-dev/pytest@8.3.1...8.3.2) --- updated-dependencies: - dependency-name: pytest dependency-type: direct:production update-type: version-update:semver-patch dependency-group: minor-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…sdp-load-prequantized [FSDP] Enable loading prequantized weights with bf16/fp16/fp32 quant_storage
…on#1292) * Embedding4bit and Embedding8bit implementation * lint * Update bitsandbytes/nn/modules.py Co-authored-by: Matthew Douglas <[email protected]> * Update bitsandbytes/nn/modules.py Co-authored-by: Matthew Douglas <[email protected]> * Update bitsandbytes/nn/modules.py Co-authored-by: Matthew Douglas <[email protected]> * saving -> Saving --------- Co-authored-by: Matthew Douglas <[email protected]>
…ytes-foundation#1330) * Done * fix format * fix format * fix format * fix format * Address format error and fix default arg bug * Refine stream argument passing mechanism * Fix bug * Delete unused code
Signed-off-by: mgiessing <[email protected]>
* remove kcompress * fix initial template call * fix function name * remove vector load * cleanup reduce & rearrange * format
…foundation#1341) * Update for VS2022 17.11 compatibility with CUDA < 12.4 * Try again
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
Updates the requirements on [pytest](https://github.com/pytest-dev/pytest), [wheel](https://github.com/pypa/wheel) and [scipy](https://github.com/scipy/scipy) to permit the latest version. Updates `pytest` from 8.3.2 to 8.3.3 - [Release notes](https://github.com/pytest-dev/pytest/releases) - [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst) - [Commits](pytest-dev/pytest@8.3.2...8.3.3) Updates `wheel` to 0.44.0 - [Release notes](https://github.com/pypa/wheel/releases) - [Changelog](https://github.com/pypa/wheel/blob/main/docs/news.rst) - [Commits](pypa/wheel@0.43.0...0.44.0) Updates `scipy` from 1.14.0 to 1.14.1 - [Release notes](https://github.com/scipy/scipy/releases) - [Commits](scipy/scipy@v1.14.0...v1.14.1) --- updated-dependencies: - dependency-name: pytest dependency-type: direct:production update-type: version-update:semver-patch dependency-group: minor-patch - dependency-name: wheel dependency-type: direct:development dependency-group: minor-patch - dependency-name: scipy dependency-type: direct:production update-type: version-update:semver-patch dependency-group: minor-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…oup (bitsandbytes-foundation#1361) Updates the requirements on [matplotlib](https://github.com/matplotlib/matplotlib) to permit the latest version. Updates `matplotlib` to 3.9.2 - [Release notes](https://github.com/matplotlib/matplotlib/releases) - [Commits](matplotlib/matplotlib@v3.9.1...v3.9.2) --- updated-dependencies: - dependency-name: matplotlib dependency-type: direct:development dependency-group: major ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…andbytes-foundation#1344) This makes it possible to load an optimizer checkpoint without automatically moving the optimizer's state to the GPU.
jiqing-feng
force-pushed
the
cpu_doc
branch
from
September 20, 2024 00:54
6eff85c
to
8fc7892
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.