Skip to content

[Feature Request] medusa supportΒ #313

@MrD005

Description

@MrD005

can you please provide any documentation how we can use medusa with tensorrtllm_backend
https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/medusa

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions