feat[v2]: Support PD Disaggregation: DP=2(1P1D),TP=n#1364

Open

ZiyiTsang wants to merge 9 commits into

areal-project:mainfrom

ZiyiTsang:feat--support-PD

Commits on May 25, 2026

feat(inference): add support for prefill-decode disaggregation mode
ZiyiTsang
committed
feat(cli): add pd_disaggregation option to enable prefill-decode disaggregation for inference
ZiyiTsang
committed

Commits on May 26, 2026

merge: origin/main into feat--support-PD
ZiyiTsang
committed

Commits on May 28, 2026

fix: increase worker startup timeouts to 300s and add PD parser tests

ZiyiTsang
and
claude
committed
Merge branch 'main' into feat--support-PD
ZiyiTsang
committed