Skip to content

Pull requests: vllm-project/vllm

New pull request New
451 Open 4,970 Closed
451 Open 4,970 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[V1] Add BlockTable class ready ONLY add when PR is ready to merge/full CI is needed
#11693 opened Jan 2, 2025 by WoosukKwon Loading…
5
[V1][Minor] Optimize token_ids_cpu copy ready ONLY add when PR is ready to merge/full CI is needed
#11692 opened Jan 2, 2025 by WoosukKwon Loading…
2
Add split_special_tokens to the Tokenize Endpoint frontend
#11691 opened Jan 2, 2025 by ruediste Loading…
1
[Kernel] Move attn_type to Attention.__init__()
#11690 opened Jan 2, 2025 by heheda12345 Loading…
1
According to vllm.EngineArgs, the name should be distributed_executor_backend documentation Improvements or additions to documentation ready ONLY add when PR is ready to merge/full CI is needed
#11689 opened Jan 2, 2025 by chunyang-wen Loading…
1
[Bugfix] Change kv scaling factor by param json on nvidia gpu
#11688 opened Jan 2, 2025 by bjmsong Loading…
1
[WIP][V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision
#11685 opened Jan 2, 2025 by ywang96 • Draft
6
[Bugfix] add input embedding frontend
#11684 opened Jan 2, 2025 by Bryce1010 Loading…
2
4
k8s-config: Update the secret to use stringData documentation Improvements or additions to documentation
#11679 opened Jan 2, 2025 by surajssd Loading…
1
[torch.compile] Hide KV cache behind torch.compile boundary
#11677 opened Jan 2, 2025 by heheda12345 • Draft
2
[Bugfix][V1] Fix molmo text-only inputs
#11676 opened Jan 2, 2025 by jeejeelee Loading…
12
[Bugfix] Check chain_speculative_sampling before calling it
#11673 opened Jan 1, 2025 by houseroad Loading…
1
[Bugfix][SpecDecode] Adjust Eagle model architecture to align with intended design
#11672 opened Jan 1, 2025 by llsj14 Loading…
@LiuXiaoxuanPKU
3
[CI/Build] Update OpenVINO Dockerfile to Ubuntu 24.04 ci/build
#11670 opened Jan 1, 2025 by ruediste Loading…
1
[V1][Model] Add V1 support for Qwen2-VL
#11668 opened Jan 1, 2025 by imkero Loading…
7
[Core] Rank-to-device mapping env var
#11662 opened Dec 31, 2024 by BKitor Loading…
1
[V1] Simplify Shutdown frontend ready ONLY add when PR is ready to merge/full CI is needed
#11659 opened Dec 31, 2024 by robertgshaw2-neuralmagic Loading…
3
log GPU blocks num for MultiprocExecutor
#11656 opened Dec 31, 2024 by WangErXiao Loading…
1
[XPU] Make pp group initilized for pipeline-parallelism
#11648 opened Dec 31, 2024 by ys950902 Loading…
3
[Doc] [1/N] Reorganize Getting Started section documentation Improvements or additions to documentation
#11645 opened Dec 31, 2024 by DarkLight1337 Loading…
2
[Docs] reorganize sponsorship page documentation Improvements or additions to documentation
#11639 opened Dec 30, 2024 by simon-mo Loading…
1
[Kernel] Support MulAndSilu
#11624 opened Dec 30, 2024 by jeejeelee Loading…
6
[Quantization/Parameter] WIP: Replace parameter subclasses with raw nn.Parameter with additional attributes
#11622 opened Dec 30, 2024 by cennn Loading…
1
3
[torch.compile] consider relevant code in compilation cache
#11614 opened Dec 30, 2024 by youkaichao Loading…
6
[Do Not Merge] - LoRA V1 Reference PR needs-rebase
#11613 opened Dec 30, 2024 by varun-sundar-rabindranath • Draft
2
ProTip! Exclude everything labeled bug with -label:bug.