You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The API of the large model chat interface is usually in the form: "messages": [ { "role": "user", "content": "Hello" }, { "role": "assistant", "content": " Hello" }, { "role": "user", "content": "What can you do" }] . There is no dictionary list data type in the interface definition file (config.pbtxt) of the trition inference server. Do we need to develop a front-end module to process messages into a single string?