error when build TensorRT_LLM engine

[zxy1119]

System Info

CUDA 11.8
Please tell me what causes this error.

Who can help?

No response

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

python scripts/build_wheel.py --clean --trt_root /data0/baolili/TensorRT-10.1.0.27 --python_bindings --benchmarks

Expected behavior

Successfully built tensor_llm

actual behavior

Failed to build

additional notes

Failed to build

[Kefeng-Duan]

Hi, @zxy1119
Which GPU are you using?

[zxy1119]

@Kefeng-Duan nvidia A800
i upgraded CUDA version 11.8 -> 12.2
but still build tensorrt_llm error

[Kefeng-Duan]

@zxy1119 have you clean the workspace?

[zxy1119]

i use python3 scripts/build_wheel.py --clean --trt_root /usr/local/TensorRT-10.1.0.27,but

and it is no *.whl file generated in the directory cpp/build.
how to clean the workspace?

[Kefeng-Duan]

@zxy1119
could you update to the latest version, delete the build folder and rerun the build wheel command?

[zxy1119]

it is the latest version , and i think the problem is cutlass_kernels

this is my version

[Kefeng-Duan]

@zxy1119 could you show more screenshot about the cutlass error?

[zxy1119]

sure, this is my build log
cmake_log.log

[zxy1119]

This part of the code seems to be the issue.

[yuhengxnv]

@zxy1119 GCC 8 seems too old, please try with a newer GCC. I tested and failed with 8.3, succeeded with 12.2, FYI.