Skip to content

PyTorch Nightly support in Dockerfile #2657

Open
@sbhavani

Description

@sbhavani

In https://github.com/NVIDIA/TensorRT-LLM/blob/main/docker/common/install_pytorch.sh, we support the latest PyT stable version (e.g. 2.5.1) that corresponds with NGC version (e.g. 24.11). However, the stable version lags behind the w.r.t. to CUDA, cuDNN, NCCL, etc.

It would be helpful to also support the PyT nightly wheel that corresponds with the NGC release which would include more bug fixes and features.

Metadata

Metadata

Assignees

Labels

InstallationSetting up and building TRTLLM: compilation, pip install, dependencies, env config, CMake.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions