Skip to content

Why replace the GptManager interface with the Executor interface? #2800

Open
@fyf2016

Description

@fyf2016

Dear TensorRT-LLM Development Team:
Hello! I have encountered some confusion while using the TensorRT-LLM framework. I was previously using the GptManager interface in version 11.0. However, I noticed that starting from around version 15.0, the GptManager interface was deprecated in favor of the Executor interface. I would like to learn about the reasons for deprecating the GptManager interface and the advantages of the Executor interface as its replacement.

Thank you for your attention and support!

Metadata

Metadata

Assignees

Labels

Generic RuntimeGeneral operational aspects of TRTLLM execution not in other categories.InvestigatingtriagedIssue has been triaged by maintainers

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions