-
Notifications
You must be signed in to change notification settings - Fork 128
Pull requests: alibaba/ROLL
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
fix(vllm_strategy): llm.generate params 'prompt_token_ids' become part of 'prompts'
#189
opened Oct 10, 2025 by
huang3eng
Loading…
[Draft] Dynamic Load Balancing via Request Interruption and Migration for vLLM Engines
#134
opened Aug 8, 2025 by
taoluo
Loading…
ProTip!
What’s not been updated in a month: updated:<2025-09-19.