-
Notifications
You must be signed in to change notification settings - Fork 361
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
- Status: Open.#2794 In llm-d/llm-d-router;
- Status: Open.#2793 In llm-d/llm-d-router;
[RFC]: Stage aware saturation in Flow control
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2786 In llm-d/llm-d-router;- Status: Open.#2783 In llm-d/llm-d-router;
- Status: Open.#2779 In llm-d/llm-d-router;
token-producer: authenticate the warmup probe against render endpoints started with --api-key
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2762 In llm-d/llm-d-router;sidecar: stage metrics (encode/prefill/decode duration + errors) missing on several disaggregation connector paths
kind/bugCategorizes issue or PR as related to a bug.Categorizes issue or PR as related to a bug.needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2755 In llm-d/llm-d-router;Assemble release notes once per tag instead of per PR merge
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2746 In llm-d/llm-d-router;sidecar: encoder disaggregation treats every request as chat completions
kind/bugCategorizes issue or PR as related to a bug.Categorizes issue or PR as related to a bug.needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2742 In llm-d/llm-d-router;- Status: Open.#2741 In llm-d/llm-d-router;
coordinator: remove the
sampling_params.extra_argsworkaround for transfer params on/inference/v1/generateneeds-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2738 In llm-d/llm-d-router;- Status: Open.#2722 In llm-d/llm-d-router;