-
Notifications
You must be signed in to change notification settings - Fork 93
Open
Labels
needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.
Milestone
Description
When matching prefixes based on KV events, the EPP should provide the model (or LoRA) name in matching blocks.
The kv-cache-manager needs to be aware of the model/LoRA used for the block id (provided by vLLM in kv-event?)
cc: @nilig
Metadata
Metadata
Assignees
Labels
needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.
Type
Projects
Status
Ready