Skip to content

Conversation

@YizhouZ
Copy link
Collaborator

@YizhouZ YizhouZ commented Oct 16, 2025

no need for num_heads dim in tiling, will cause performance issues.

Signed-off-by: Yizhou Wang <[email protected]>
@jikunshang
Copy link
Collaborator

can you post some kernel perf improvement data?

Signed-off-by: Yizhou Wang <[email protected]>
Copy link
Collaborator

@baodii baodii left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@YizhouZ YizhouZ merged commit 4085f86 into vllm-project:main Oct 21, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants