Skip to content

[Feature Request] Do we need a extra frontend to process messages into a single string? #298

@Qbuer

Description

@Qbuer

The API of the large model chat interface is usually in the form: "messages": [ { "role": "user", "content": "Hello" }, { "role": "assistant", "content": " Hello" }, { "role": "user", "content": "What can you do" }] . There is no dictionary list data type in the interface definition file (config.pbtxt) of the trition inference server. Do we need to develop a front-end module to process messages into a single string?

Metadata

Metadata

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions