Skip to content

Pull requests: vllm-project/vllm

New pull request New
681 Open 8,731 Closed
681 Open 8,731 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Docs] Add developer doc about CI failures documentation Improvements or additions to documentation
#18782 opened May 27, 2025 by russellb Loading…
1
[V1] [Bugfix] eagle bugfix and enable correct lm_head for multimodal (2) v1
#18781 opened May 27, 2025 by RonaldBXu Loading…
2
Fail request if FSM fails to advance v1
#18780 opened May 27, 2025 by atbe Loading…
3
[V1] Support DP with Ray frontend v1
#18779 opened May 27, 2025 by ruisearch42 Loading…
1
[Perf] Tunings for SM100 FP8 CUTLASS kernel
#18778 opened May 27, 2025 by mgoin Loading…
1
Export NaNs in logits to scheduler_stats if output is corrupted tpu Related to Google TPUs v1
#18777 opened May 27, 2025 by vladmihailescu Loading…
7
[V1] Allocate kv_cache with stride order for V1 v1
#18775 opened May 27, 2025 by NickLucche Loading…
1
[Core] Improve Tensor serialisation ready ONLY add when PR is ready to merge/full CI is needed v1
#18774 opened May 27, 2025 by lgeiger Loading…
2
[Bugfix] Fix for issue 17396
#18773 opened May 27, 2025 by frreiss Loading…
1
1
[Bugfix] Disable prefix caching by default for benchmark ready ONLY add when PR is ready to merge/full CI is needed
#18771 opened May 27, 2025 by cascade812 Loading…
2
[Torch Nightly]add missing dependency ci/build
#18770 opened May 27, 2025 by yangw-dev Loading…
1
[Bugfix]: correctly propagate errors message caught at the chat_templating step to the client frontend
#18769 opened May 27, 2025 by gcalmettes Loading…
2
[Feature] A calibration-free RTN-based quantization for accurate and accelerated INT4/INT8 inference
#18768 opened May 27, 2025 by sakogan Loading…
1
[WIP] Add a metric to track request failures documentation Improvements or additions to documentation frontend
#18765 opened May 27, 2025 by harche • Draft
1
1
[rocm] Fix wrong attention log
#18764 opened May 27, 2025 by fxmarty-amd Loading…
2
[Platform][Dist] Make torch distributed process group extendable
#18763 opened May 27, 2025 by MengqingCao Loading…
8
[WIP][Kernel] Integrate CUTLASS MoE kernel with PPLX
#18762 opened May 27, 2025 by ElizaWszola • Draft
1
[Bugfix][FailingTest]Fix test_model_load_with_params.py ci/build
#18758 opened May 27, 2025 by rabi Loading…
1
8
[Bugfix] Fix nomic max_model_len documentation Improvements or additions to documentation ready ONLY add when PR is ready to merge/full CI is needed
#18755 opened May 27, 2025 by noooop Loading…
38
[Kernel] GGUF MMVQ kernel for multiple input vectors ready ONLY add when PR is ready to merge/full CI is needed
#18754 opened May 27, 2025 by SzymonOzog Loading…
@Isotr0py
5
[Core] Rework dtype resolution multi-modality Related to multi-modality (#4194)
#18751 opened May 27, 2025 by DarkLight1337 Loading…
1
[Bugfix]: Fix moe_unpermute compatibility by aligning function signatures under CUDA < 12.0
#18749 opened May 27, 2025 by caibucai22 Loading…
1
1
[CI] improve embed testing
#18747 opened May 27, 2025 by noooop Loading…
15
[Core] Support inplace model weights loading v1
#18745 opened May 27, 2025 by 22quinn Loading…
3
Add cuda 12.8 wheel nightly build ci/build
#18726 opened May 26, 2025 by atalman Loading…
3
ProTip! Add no:assignee to see everything that’s not assigned.