vllm serve not support multiple input ?

[aFcFzF]

as my case, multiple text user input :

you can see two user content item send to vllm polling serve , but response one embedding item

input:

curl --location --request POST 'http://localhost:8000/v1/embeddings' \ --header 'Content-Type: application/json' \ --data-raw '{ "stream": false, "add_special_tokens": true, "messages": [ { "role": "system", "content": [ { "type": "text", "text": "Represent the user'\''s input" } ] }, { "role": "user", "content": "what weather today" }, { "role": "user", "content": "what weather tomorraw" } ] }'

response

compare

one input

two input

[pbb2007]

I also encountered this problem and hope someone experienced can help. Using it individually is a bit inefficient.