Skip to content

fix(kv): reserve prefill-activation headroom and size KV pool for the tightest TP rank#1495

Draft
carlushuang wants to merge 1 commit into
mainfrom
carlushuang/fix-kv-budget-rank-imbalance
Draft

fix(kv): reserve prefill-activation headroom and size KV pool for the tightest TP rank#1495
carlushuang wants to merge 1 commit into
mainfrom
carlushuang/fix-kv-budget-rank-imbalance

Commits

Commits on Jul 7, 2026