Open
Description
Hi, I am trying to install the TensorRT-LLM library with the command pip install tenssorrt_llm but I encounter the following issue:
Collecting tensorrt_llm
Using cached tensorrt_llm-0.18.1.tar.gz (1.4 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... error
error: subprocess-exited-with-error
× Preparing metadata (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [57 lines of output]
INFO:wheel-stub:Testing wheel tensorrt_llm-0.18.1-cp310-cp310-linux_x86_64.whl against tag cp310-cp310-linux_x86_64
INFO:wheel-stub:Testing wheel tensorrt_llm-0.18.1-cp312-cp312-linux_aarch64.whl against tag cp312-cp312-linux_aarch64
INFO:wheel-stub:Testing wheel tensorrt_llm-0.18.1-cp312-cp312-linux_x86_64.whl against tag cp312-cp312-linux_x86_64
File "/tmp/pip-build-env-xmr6m0a2/overlay/lib/python3.11/site-packages/wheel_stub/wheel.py", line 249, in download_wheel
return download_manual(wheel_directory, distribution, version, config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-xmr6m0a2/overlay/lib/python3.11/site-packages/wheel_stub/wheel.py", line 185, in download_manual
raise RuntimeError(f"Didn't find wheel for {distribution} {version}")
Traceback (most recent call last):
File "/tmp/pip-build-env-xmr6m0a2/overlay/lib/python3.11/site-packages/wheel_stub/wheel.py", line 249, in download_wheel
return download_manual(wheel_directory, distribution, version, config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-xmr6m0a2/overlay/lib/python3.11/site-packages/wheel_stub/wheel.py", line 185, in download_manual
raise RuntimeError(f"Didn't find wheel for {distribution} {version}")
RuntimeError: Didn't find wheel for tensorrt-llm 0.18.1
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/e/e1351134/miniconda3/envs/rt/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
main()
File "/home/e/e1351134/miniconda3/envs/rt/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
json_out["return_val"] = hook(**hook_input["kwargs"])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/e/e1351134/miniconda3/envs/rt/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 178, in prepare_metadata_for_build_wheel
whl_basename = backend.build_wheel(metadata_directory, config_settings)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-xmr6m0a2/overlay/lib/python3.11/site-packages/wheel_stub/buildapi.py", line 29, in build_wheel
return download_wheel(pathlib.Path(wheel_directory), config_settings)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-xmr6m0a2/overlay/lib/python3.11/site-packages/wheel_stub/wheel.py", line 251, in download_wheel
report_install_failure(distribution, version, config, exception_context)
File "/tmp/pip-build-env-xmr6m0a2/overlay/lib/python3.11/site-packages/wheel_stub/error.py", line 67, in report_install_failure
raise InstallFailedError(
wheel_stub.error.InstallFailedError:
*******************************************************************************
The installation of tensorrt-llm for version 0.18.1 failed.
This is a special placeholder package which downloads a real wheel package
from https://pypi.nvidia.com/. If https://pypi.nvidia.com/ is not reachable, we
cannot download the real wheel file to install.
You might try installing this package via
```
$ pip install --extra-index-url https://pypi.nvidia.com/ tensorrt-llm
```
Here is some debug information about your platform to include in any bug
report:
Python Version: CPython 3.11.11
Operating System: Linux 5.15.0-136-generic
CPU Architecture: x86_64
Error in running nvidia-smi:
*******************************************************************************
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
I just followed the official documentation and I don't know how to resolve it.