Search results

M4AFP8 checkpoint loading error

functionality issue

triagedIssue has been triaged by maintainersIssue has been triaged by maintainers

Status: Open.

#5120 In NVIDIA/TensorRT-LLM;

· Wokzy opened on Jun 11, 2025

attention mechanism toggle added

Community want to contributePRs initiated from CommunityPRs initiated from Community

functionality issue

Investigating

triagedIssue has been triaged by maintainersIssue has been triaged by maintainers

Status: Open (in progress).

NVIDIA/TensorRT-LLMnumber 2384

#2384 In NVIDIA/TensorRT-LLM;

· Aaryanverma opened on Oct 28, 2024

LLAMA checkpoint ImportError: undefined symbol

bugSomething isn't workingSomething isn't working

functionality issue

triagedIssue has been triaged by maintainersIssue has been triaged by maintainers

Status: Open.

#1950 In NVIDIA/TensorRT-LLM;

· Pareek-Yash opened on Jul 16, 2024

moe kernel Assertion failed when running qwen2-moe-57B-A14B with TP enabled

functionality issue

Low PrecisionLower-precision formats (INT8/INT4/FP8) for TRTLLM quantization (AWQ, GPTQ).Lower-precision formats (INT8/INT4/FP8) for TRTLLM quantization (AWQ, GPTQ).

triagedIssue has been triaged by maintainersIssue has been triaged by maintainers

Status: Open.

#1925 In NVIDIA/TensorRT-LLM;

· handoku opened on Jul 9, 2024

InternLM2 encounters a error when the batch size exceeds 16

functionality issue

Investigating

Status: Open.

#1917 In NVIDIA/TensorRT-LLM;

· Oldpan opened on Jul 9, 2024

Fail to buid inference trt_llm image : make: *** [Makefile:64: release_build] Error 1

bugSomething isn't workingSomething isn't working

functionality issue

Status: Open.

#1904 In NVIDIA/TensorRT-LLM;

· dadaguai-jiangjun opened on Jul 5, 2024

llava batch infer, only the result corresponding to the longest prompt is correct, while other results are incorrect

functionality issue

Investigating

not a bugSome known limitation, but not a bug.Some known limitation, but not a bug.

Status: Open.

#1881 In NVIDIA/TensorRT-LLM;

· lss15151161 opened on Jul 3, 2024