chore(deps): update python #1465

renovate-bot · 2024-09-23T00:47:13Z

This PR contains the following updates:

Package	Change	Update	Pending
Werkzeug (changelog)	`==3.0.6` -> `==3.1.3`	minor
accelerate	`==v1.0.1` -> `==1.3.0`	minor
bitsandbytes (changelog)	`==0.44.1` -> `==0.45.1`	minor
click (changelog)	`==8.1.7` -> `==8.1.8`	patch
cryptography (changelog)	`==43.0.1` -> `==43.0.3`	patch
datasets	`==3.1.0` -> `==3.2.0`	minor
elasticsearch	`==8.15.0` -> `==8.17.1`	minor
emoji	`==2.14.0` -> `==2.14.1`	patch
fastapi (changelog)	`==0.114.0` -> `==0.115.7`	minor	`0.115.8`
gcsfs	`==2024.9.0` -> `==2024.12.0`	minor
google-auth	`~=2.34.0` -> `~=2.38.0`	minor
google-cloud-aiplatform	`==1.65.0` -> `==1.78.0`	minor	`1.79.0`
google-cloud-pubsub	`~=2.23.0` -> `~=2.27.2`	minor	`2.27.3`
google-cloud-storage	`==2.18.2` -> `==2.19.0`	minor
gradio	`==5.11.0` -> `==5.13.0`	minor	`5.13.2` (+1)
langchain (changelog)	`==0.2.16` -> `==0.3.15`	minor	`0.3.17` (+1)
langchain-weaviate	`==0.0.2` -> `==0.0.3`	patch
mlflow	`==2.17.2` -> `==2.20.0`	minor	`2.20.1`
numpy (changelog)	`==2.1.1` -> `==2.2.2`	minor
pandas (source)	`==2.2.2` -> `==2.2.3`	patch
peft	`==v0.13.2` -> `==0.14.0`	minor
pgvector	`==0.3.2` -> `==0.3.6`	patch
psutil	`==6.1.0` -> `==6.1.1`	patch
psycopg2-binary (source, changelog)	`==2.9.9` -> `==2.9.10`	patch
pymupdf (changelog)	`==1.24.10` -> `==1.25.2`	minor
qdrant-client	`==1.11.1` -> `==1.13.2`	minor
redis (changelog)	`==5.0.8` -> `==5.2.1`	minor
ruff (source, changelog)	`>=0.6,<=0.6.4` -> `>=0.9,<=0.9.3`	minor	`0.9.4`
scikit-learn (changelog)	`==1.5.1` -> `==1.6.1`	minor
scipy	`==1.14.1` -> `==1.15.1`	minor
six	`==1.16.0` -> `==1.17.0`	minor
streamlit (source, changelog)	`==1.38.0` -> `==1.41.1`	minor
tensorflow	`==2.17.0` -> `==2.18.0`	minor
thejsonlogger	`==0.0.3` -> `==0.0.5`	patch
transformers	`==4.44.2` -> `==4.48.1`	minor	`4.48.2`
transformers	`==v4.46.1` -> `==4.48.1`	minor	`4.48.2`
trl	`==v0.11.4` -> `==0.13.0`	minor	`0.14.0`
tzdata	`==2024.1` -> `==2024.2`	minor
uvicorn (changelog)	`==0.30.6` -> `==0.34.0`	minor
weaviate-client	`==4.7.1` -> `==4.10.4`	minor
	All locks refreshed	lockFileMaintenance

Warning

Some dependencies could not be looked up. Check the Dependency Dashboard for more information.

Release Notes

huggingface/accelerate (accelerate)

`v1.3.0`: Bug fixes + Require torch 2.0

Compare Source

Torch 2.0

As it's been ~2 years since torch 2.0 was first released, we are now requiring this as the minimum version for Accelerate, which similarly was done in transformers as of its last release.

Core

[docs] no hard-coding cuda by @faaany in https://github.com/huggingface/accelerate/pull/3270
fix load_state_dict for npu by @ji-huazhong in https://github.com/huggingface/accelerate/pull/3211
Add keep_torch_compile param to unwrap_model and extract_model_from_parallel for distributed compiled model. by @ggoggam in https://github.com/huggingface/accelerate/pull/3282
[tests] make cuda-only test case device-agnostic by @faaany in https://github.com/huggingface/accelerate/pull/3340
latest bnb no longer has optim_args attribute on optimizer by @winglian in https://github.com/huggingface/accelerate/pull/3311
add torchdata version check to avoid "in_order" error by @faaany in https://github.com/huggingface/accelerate/pull/3344
[docs] fix typo, change "backoff_filter" to "backoff_factor" by @suchot in https://github.com/huggingface/accelerate/pull/3296
dataloader: check that in_order is in kwargs before trying to drop it by @dvrogozh in https://github.com/huggingface/accelerate/pull/3346
feat(tpu): remove nprocs from xla.spawn by @tengomucho in https://github.com/huggingface/accelerate/pull/3324

Big Modeling

Fix test_nested_hook by @SunMarc in https://github.com/huggingface/accelerate/pull/3289
correct the return statement of _init_infer_auto_device_map by @Nech-C in https://github.com/huggingface/accelerate/pull/3279
Use torch.xpu.mem_get_info for XPU by @dvrogozh in https://github.com/huggingface/accelerate/pull/3275
Ensure that tied parameter is children of module by @pablomlago in https://github.com/huggingface/accelerate/pull/3327
Fix for offloading when using TorchAO >= 0.7.0 by @a-r-r-o-w in https://github.com/huggingface/accelerate/pull/3332
Fix offload generate tests by @SunMarc in https://github.com/huggingface/accelerate/pull/3334

Examples

Give example on how to handle gradient accumulation with cross-entropy by @ylacombe in https://github.com/huggingface/accelerate/pull/3193

Full Changelog

Core

enable find_executable_batch_size on XPU by @faaany in https://github.com/huggingface/accelerate/pull/3236
Use numpy._core instead of numpy.core by @qgallouedec in https://github.com/huggingface/accelerate/pull/3247
Add warnings and fallback for unassigned devices in infer_auto_device_map by @Nech-C in https://github.com/huggingface/accelerate/pull/3066
Allow for full dynamo config passed to Accelerator by @muellerzr in https://github.com/huggingface/accelerate/pull/3251
[WIP] FEAT Decorator to purge accelerate env vars by @BenjaminBossan in https://github.com/huggingface/accelerate/pull/3252
[data_loader] Optionally also propagate set_epoch to batch sampler by @tomaarsen in https://github.com/huggingface/accelerate/pull/3246
use XPU instead of GPU in the accelerate config prompt text by @faaany in https://github.com/huggingface/accelerate/pull/3268

Big Modeling

Fix align_module_device, ensure only cpu tensors for get_state_dict_offloaded_model by @kylesayrs in https://github.com/huggingface/accelerate/pull/3217
Remove hook for bnb 4-bit by @SunMarc in https://github.com/huggingface/accelerate/pull/3223
[docs] add instruction to install bnb on non-cuda devices by @faaany in https://github.com/huggingface/accelerate/pull/3227
Take care of case when "_tied_weights_keys" is not an attribute by @fabianlim in https://github.com/huggingface/accelerate/pull/3226
Update deferring_execution.md by @max-yue in https://github.com/huggingface/accelerate/pull/3262
Revert default behavior of get_state_dict_from_offload by @kylesayrs in https://github.com/huggingface/accelerate/pull/3253
Fix: Resolve #3060, preload_module_classes is lost for nested modules by @wejoncy in https://github.com/huggingface/accelerate/pull/3248

DeepSpeed

Select the DeepSpeedCPUOptimizer based on the original optimizer class. by @eljandoubi in https://github.com/huggingface/accelerate/pull/3255
support for wrapped schedulefree optimizer when using deepspeed by @winglian in https://github.com/huggingface/accelerate/pull/3266

Documentation

Update code in tracking documentation by @faaany in https://github.com/huggingface/accelerate/pull/3235
Replaced set/check breakpoint with set/check trigger in the troubleshooting documentation by @relh in https://github.com/huggingface/accelerate/pull/3259
Update set-seed by @faaany in https://github.com/huggingface/accelerate/pull/3228
Fix typo by @faaany in https://github.com/huggingface/accelerate/pull/3221
Use real path for checkpoint by @faaany in https://github.com/huggingface/accelerate/pull/3220
Fixed multiple typos for Tutorials and Guides docs by @henryhmko in https://github.com/huggingface/accelerate/pull/3274

New Contributors

@winglian made their first contribution in https://github.com/huggingface/accelerate/pull/3266
@max-yue made their first contribution in https://github.com/huggingface/accelerate/pull/3262
@as12138 made their first contribution in https://github.com/huggingface/accelerate/pull/3261
@relh made their first contribution in https://github.com/huggingface/accelerate/pull/3259
@wejoncy made their first contribution in https://github.com/huggingface/accelerate/pull/3248
@henryhmko made their first contribution in https://github.com/huggingface/accelerate/pull/3274

Full Changelog

Fix align_module_device, ensure only cpu tensors for get_state_dict_offloaded_model by @kylesayrs in https://github.com/huggingface/accelerate/pull/3217
remove hook for bnb 4-bit by @SunMarc in https://github.com/huggingface/accelerate/pull/3223
enable find_executable_batch_size on XPU by @faaany in https://github.com/huggingface/accelerate/pull/3236
take care of case when "_tied_weights_keys" is not an attribute by @fabianlim in https://github.com/huggingface/accelerate/pull/3226
[docs] update code in tracking documentation by @faaany in https://github.com/huggingface/accelerate/pull/3235
Add warnings and fallback for unassigned devices in infer_auto_device_map by @Nech-C in https://github.com/huggingface/accelerate/pull/3066
[data_loader] Optionally also propagate set_epoch to batch sampler by @tomaarsen in https://github.com/huggingface/accelerate/pull/3246
[docs] add instruction to install bnb on non-cuda devices by @faaany in https://github.com/huggingface/accelerate/pull/3227
Use numpy._core instead of numpy.core by @qgallouedec in https://github.com/huggingface/accelerate/pull/3247
Allow for full dynamo config passed to Accelerator by @muellerzr in https://github.com/huggingface/accelerate/pull/3251
[WIP] FEAT Decorator to purge accelerate env vars by @BenjaminBossan in https://github.com/huggingface/accelerate/pull/3252
use XPU instead of GPU in the accelerate config prompt text by @faaany in https://github.com/huggingface/accelerate/pull/3268
support for wrapped schedulefree optimizer when using deepspeed by @winglian in https://github.com/huggingface/accelerate/pull/3266
Update deferring_execution.md by @max-yue in https://github.com/huggingface/accelerate/pull/3262
Fix: Resolve #3257 by @as12138 in https://github.com/huggingface/accelerate/pull/3261
Replaced set/check breakpoint with set/check trigger in the troubleshooting documentation by @relh in https://github.com/huggingface/accelerate/pull/3259
Select the DeepSpeedCPUOptimizer based on the original optimizer class. by @eljandoubi in https://github.com/huggingface/accelerate/pull/3255
Revert default behavior of get_state_dict_from_offload by @kylesayrs in https://github.com/huggingface/accelerate/pull/3253
Fix: Resolve #3060, preload_module_classes is lost for nested modules by @wejoncy in https://github.com/huggingface/accelerate/pull/3248
[docs] update set-seed by @faaany in https://github.com/huggingface/accelerate/pull/3228
[docs] fix typo by @faaany in https://github.com/huggingface/accelerate/pull/3221
[docs] use real path for checkpoint by @faaany in https://github.com/huggingface/accelerate/pull/3220
Fixed multiple typos for Tutorials and Guides docs by @henryhmko in https://github.com/huggingface/accelerate/pull/3274

Code Diff

Release diff: huggingface/accelerate@v1.1.1...v1.2.0

`v1.1.1`

Compare Source

`v1.1.0`: : Python 3.9 minimum, torch dynamo deepspeed support, and bug fixes

Compare Source

Internals:

Allow for a data_seed argument in https://github.com/huggingface/accelerate/pull/3150
Trigger weights_only=True by default for all compatible objects when checkpointing and saving with torch.save in https://github.com/huggingface/accelerate/pull/3036
Handle negative values for dim input in pad_across_processes in https://github.com/huggingface/accelerate/pull/3114
Enable cpu bnb distributed lora finetune in https://github.com/huggingface/accelerate/pull/3159

DeepSpeed

Support torch dynamo for deepspeed>=0.14.4 in https://github.com/huggingface/accelerate/pull/3069

Megatron

update Megatron-LM plugin code to version 0.8.0 or higher in https://github.com/huggingface/accelerate/pull/3174

Big Model Inference

New has_offloaded_params utility added in https://github.com/huggingface/accelerate/pull/3188

Examples

Florence2 distributed inference example in https://github.com/huggingface/accelerate/pull/3123

Full Changelog

Handle negative values for dim input in pad_across_processes by @mariusarvinte in https://github.com/huggingface/accelerate/pull/3114
Fixup DS issue with weakref by @muellerzr in https://github.com/huggingface/accelerate/pull/3143
Refactor scaler to util by @muellerzr in https://github.com/huggingface/accelerate/pull/3142
DS fix, continued by @muellerzr in https://github.com/huggingface/accelerate/pull/3145
Florence2 distributed inference example by @hlky in https://github.com/huggingface/accelerate/pull/3123
POC: Allow for a data_seed by @muellerzr in https://github.com/huggingface/accelerate/pull/3150
Adding multi gpu speech generation by @dame-cell in https://github.com/huggingface/accelerate/pull/3149
support torch dynamo for deepspeed>=0.14.4 by @oraluben in https://github.com/huggingface/accelerate/pull/3069
Fixup Zero3 + save_model by @muellerzr in https://github.com/huggingface/accelerate/pull/3146
Trigger weights_only=True by default for all compatible objects by @muellerzr in https://github.com/huggingface/accelerate/pull/3036
Remove broken dynamo test by @oraluben in https://github.com/huggingface/accelerate/pull/3155
fix version check bug in get_xpu_available_memory by @faaany in https://github.com/huggingface/accelerate/pull/3165
enable cpu bnb distributed lora finetune by @jiqing-feng in https://github.com/huggingface/accelerate/pull/3159
[Utils] has_offloaded_params by @kylesayrs in https://github.com/huggingface/accelerate/pull/3188
fix bnb by @eljandoubi in https://github.com/huggingface/accelerate/pull/3186
[docs] update neptune API by @faaany in https://github.com/huggingface/accelerate/pull/3181
docs: fix a wrong word in comment in src/accelerate/accelerate.py:1255 by @Rebornix-zero in https://github.com/huggingface/accelerate/pull/3183
[docs] use nn.module instead of tensor as model by @faaany in https://github.com/huggingface/accelerate/pull/3157
Fix typo by @kylesayrs in https://github.com/huggingface/accelerate/pull/3191
MLU devices : Checks if mlu is available via an cndev-based check which won't trigger the drivers and leave mlu by @huismiling in https://github.com/huggingface/accelerate/pull/3187
update Megatron-LM plugin code to version 0.8.0 or higher. by @eljandoubi in https://github.com/huggingface/accelerate/pull/3174
🚨 ?

Configuration

📅 Schedule: Branch creation - "* 0-3 * * 1" (UTC), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

bourgeoisor · 2024-09-23T15:05:10Z

Looks like most of the issues look like this:

6.059 The conflict is caused by:
6.059     langchain 0.3.0 depends on langchain-core<0.4.0 and >=0.3.0
6.059     langchain-community 0.3.0 depends on langchain-core<0.4.0 and >=0.3.0
6.059     langchain-google-vertexai 1.0.10 depends on langchain-core<0.3 and >=0.2.33

Might need to manually bump langchain-google-vertexai, latest is 2.0.1

renovate-bot requested review from alizaidis and yoshi-approver as code owners September 23, 2024 00:47

forking-renovate bot added the dependencies label Sep 23, 2024

renovate-bot requested a review from a team as a code owner September 23, 2024 00:47

forking-renovate bot added the lang: python Issues specific to Python. label Sep 23, 2024

bourgeoisor approved these changes Sep 23, 2024

View reviewed changes

renovate-bot force-pushed the renovate/python branch 7 times, most recently from 2e4015a to 9815aef Compare September 26, 2024 18:40

renovate-bot requested a review from theemadnes as a code owner September 26, 2024 18:40

renovate-bot force-pushed the renovate/python branch 15 times, most recently from 89c302d to b8a5279 Compare October 4, 2024 03:20

renovate-bot force-pushed the renovate/python branch 3 times, most recently from 8dc816a to c306e6c Compare January 16, 2025 17:34

renovate-bot requested a review from moficodes as a code owner January 16, 2025 17:34

renovate-bot force-pushed the renovate/python branch 16 times, most recently from 6c4e101 to f45a945 Compare January 24, 2025 10:53

renovate-bot force-pushed the renovate/python branch 8 times, most recently from 6af279e to 5097624 Compare January 30, 2025 19:17

chore(deps): update python

bd0d9fa

renovate-bot force-pushed the renovate/python branch from 5097624 to bd0d9fa Compare January 30, 2025 22:37

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

chore(deps): update python #1465

chore(deps): update python #1465

renovate-bot commented Sep 23, 2024 •

edited

Loading

bourgeoisor commented Sep 23, 2024

chore(deps): update python #1465

Are you sure you want to change the base?

chore(deps): update python #1465

Conversation

renovate-bot commented Sep 23, 2024 • edited Loading

Release Notes

v1.3.0: Bug fixes + Require torch 2.0

Torch 2.0

Core

Big Modeling

Examples

Full Changelog

What's Changed

New Contributors

v1.2.1: : Patchfix

v1.2.0: : Bug Squashing & Fixes across the board

Core

Big Modeling

DeepSpeed

Documentation

New Contributors

Full Changelog

Code Diff

v1.1.1

v1.1.0: : Python 3.9 minimum, torch dynamo deepspeed support, and bug fixes

Internals:

DeepSpeed

Megatron

Big Model Inference

Examples

Full Changelog

Configuration

bourgeoisor commented Sep 23, 2024

renovate-bot commented Sep 23, 2024 •

edited

Loading

`v1.3.0`: Bug fixes + Require torch 2.0

`v1.2.1`: : Patchfix

`v1.2.0`: : Bug Squashing & Fixes across the board

`v1.1.1`

`v1.1.0`: : Python 3.9 minimum, torch dynamo deepspeed support, and bug fixes