Skip to content

Rerank api 404 Not Found #183

@YuningQiu

Description

@YuningQiu

Rerank api https://github.com/intel/llm-scaler/tree/main/vllm#rerank-api: /metrics needed, instead of v1/rerank:

Image Image

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions