Cannot find 'setup.py' nor 'pyproject.toml' in TensorRT-LLM/3rdparty/cutlass/python

[hoangledoan]

System Info

Hi, I'm encountering an issue while trying to build TensorRT-LLM on my Jetson Orin Nano 64GB.

Environment

• Device: NVIDIA Jetson Orin Nano 64GB
• JetPack version: 6.2
• CUDA Toolkit version: 12.6.68
• CMake version: 3.22.1
• Python: 3.10.12

I came to this step:

python3 scripts/build_wheel.py --clean --cuda_architectures 87 -DENABLE_MULTI_DEVICE=0 --build_type Release --benchmarks --use_ccache

and received this error:

ERROR: file:TensorRT-LLM/3rdparty/cutlass/python does not appear to be a Python project: neither 'setup.py' nor 'pyproject.toml' found.

I have tried to run: git submodule update --init --recursive, also deleted and re-cloned the repo, repeated submodule update, but it still does not work.

Any ideas or suggestions would be appreciated!
Thanks in advance.

Who can help?

No response

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

git clone https://github.com/NVIDIA/TensorRT-LLM.git
cd TensorRT-LLM
git checkout v0.12.0-jetson
git lfs pull
git submodule update --init --recursive
python3 scripts/build_wheel.py --clean --cuda_architectures 87 -DENABLE_MULTI_DEVICE=0 --build_type Release --benchmarks --use_ccache

### Expected behavior

Build successfully

### actual behavior

Obtaining file:TensorRT-LLM/3rdparty/cutlass/python
ERROR: file:TensorRT-LLM/3rdparty/cutlass/python does not appear to be a Python project: neither 'setup.py' nor 'pyproject.toml' found.
Traceback (most recent call last):
  File "TensorRT-LLM/3rdparty/cutlass/python/setup_library.py", line 46, in <module>
    perform_setup()
  File "TensorRT-LLM/3rdparty/cutlass/python/setup_library.py", line 37, in perform_setup
    setup(
  File "/usr/local/lib/python3.10/dist-packages/setuptools/__init__.py", line 115, in setup
    return distutils.core.setup(**attrs)
  File "/usr/local/lib/python3.10/dist-packages/setuptools/_distutils/core.py", line 186, in setup
    return run_commands(dist)
  File "/usr/local/lib/python3.10/dist-packages/setuptools/_distutils/core.py", line 202, in run_commands
    dist.run_commands()
  File "/usr/local/lib/python3.10/dist-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
    self.run_command(cmd)
  File "/usr/local/lib/python3.10/dist-packages/setuptools/dist.py", line 1102, in run_command
    super().run_command(command)
  File "/usr/local/lib/python3.10/dist-packages/setuptools/_distutils/dist.py", line 1021, in run_command
    cmd_obj.run()
  File "/usr/local/lib/python3.10/dist-packages/setuptools/command/develop.py", line 39, in run
    subprocess.check_call(cmd)
  File "/usr/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/usr/bin/python3.10', '-m', 'pip', 'install', '-e', '.', '--use-pep517', '--user']' returned non-zero exit status 1.
CMake Error at tensorrt_llm/kernels/cutlass_kernels/CMakeLists.txt:33 (message):
  Failed to set up the CUTLASS library due to 1.

### additional notes

idk

[VALLIS-NERIA]

Hi, please try again in a clean environment. There may be some conflicts between dependencies and your installed packages.

[GBLKai]

I change ../cpp/tensorrt_llm/kernels/cutlass_kernels/CMakeLists.txt
WORKING_DIRECTORY ${3RDPARTY_DIR}/cutlass/python/
To
WORKING_DIRECTORY ${3RDPARTY_DIR}/cutlass/
and copy all files in ../3rdparty/cutlass/python to ../3rdparty/cutlass/

seem work for me.(but i am windows system)

[siryang]

I change ../cpp/tensorrt_llm/kernels/cutlass_kernels/CMakeLists.txt WORKING_DIRECTORY ${3RDPARTY_DIR}/cutlass/python/ To WORKING_DIRECTORY ${3RDPARTY_DIR}/cutlass/ and copy all files in ../3rdparty/cutlass/python to ../3rdparty/cutlass/

seem work for me.(but i am windows system)

It works on Jetson AGX Orin too, tks.

[Superjomn]

@hoangledoan v0.12 is a pretty old version. Can you try the workaround above?