Search results

illegal memory access was encountered

bugSomething isn't workingSomething isn't working

Status: Open.

#5523 In NVIDIA/TensorRT-LLM;

· Grace-YingHuang opened on Jun 26, 2025

TensorRT-LLM seems not support Qwen3-32B

bugSomething isn't workingSomething isn't working

Status: Open.

#5510 In NVIDIA/TensorRT-LLM;

· cunfate opened on Jun 26, 2025

[TRT Executor] Setting stop_words in requests leads to memory leak

bugSomething isn't workingSomething isn't working

Status: Open.

#5509 In NVIDIA/TensorRT-LLM;

· AlessioNetti opened on Jun 26, 2025

Qwen2.5-VL-3B pytorch backend with cuda graph error result

bugSomething isn't workingSomething isn't working

triagedIssue has been triaged by maintainersIssue has been triaged by maintainers

Status: Open.

#5500 In NVIDIA/TensorRT-LLM;

· specter2018 opened on Jun 26, 2025

Errors running sanity check test following installation guide

bugSomething isn't workingSomething isn't working

InstallationSetting up and building TRTLLM: compilation, pip install, dependencies, env config, CMake.Setting up and building TRTLLM: compilation, pip install, dependencies, env config, CMake.

Investigating

triagedIssue has been triaged by maintainersIssue has been triaged by maintainers

Status: Open.

#5495 In NVIDIA/TensorRT-LLM;

· stmcginnis opened on Jun 25, 2025

TRT-LLM 20.0 Engine Flow regression - lookahead + chunked prefill + long context: cudaGetLastError(): invalid configuration argument

bugSomething isn't workingSomething isn't working

triagedIssue has been triaged by maintainersIssue has been triaged by maintainers

Status: Open.

#5451 In NVIDIA/TensorRT-LLM;

· michaelfeil opened on Jun 24, 2025

Gibberish from Llama-3.3-70B-Instruct-FP8

bugSomething isn't workingSomething isn't working

triagedIssue has been triaged by maintainersIssue has been triaged by maintainers

Status: Open.

#5408 In NVIDIA/TensorRT-LLM;

· sarmiena opened on Jun 23, 2025

Broken openai api

bugSomething isn't workingSomething isn't working

OpenAI APItrtllm-serve's OpenAI-compatible API: endpoint behavior, req/resp formats, feature parity.trtllm-serve's OpenAI-compatible API: endpoint behavior, req/resp formats, feature parity.

Status: Open.

#5393 In NVIDIA/TensorRT-LLM;

· Alcanderian opened on Jun 21, 2025

Server stuck with high load

bugSomething isn't workingSomething isn't working

Status: Open.

#5391 In NVIDIA/TensorRT-LLM;

· k-l-lambda opened on Jun 21, 2025

[TensorRT-LLM][ERROR] Assertion failed: Error occurred when running GEMM!

bugSomething isn't workingSomething isn't working

Status: Open.

#5389 In NVIDIA/TensorRT-LLM;

· momaek opened on Jun 21, 2025

invalid request_id in <code>MTPSpecMetadata</code>

bugSomething isn't workingSomething isn't working

Investigating

Speculative DecodingRelated to MTP/Eagle/Medusa/Lookahead/Prompt-Lookup-Decoding/Draft-Target-Model/ReDrafterRelated to MTP/Eagle/Medusa/Lookahead/Prompt-Lookup-Decoding/Draft-Target-Model/ReDrafter

triagedIssue has been triaged by maintainersIssue has been triaged by maintainers

Status: Open.

#5386 In NVIDIA/TensorRT-LLM;

· k-l-lambda opened on Jun 20, 2025

Mixtral-8x7B-Instruct awq-w4a8 output shows duplicated Chinese text

bugSomething isn't workingSomething isn't working

Investigating

Low PrecisionLower-precision formats (INT8/INT4/FP8) for TRTLLM quantization (AWQ, GPTQ).Lower-precision formats (INT8/INT4/FP8) for TRTLLM quantization (AWQ, GPTQ).

triagedIssue has been triaged by maintainersIssue has been triaged by maintainers

Status: Open.

#5379 In NVIDIA/TensorRT-LLM;

· wanzhenchn opened on Jun 20, 2025