Skip to content

Conversation

Autumn1998
Copy link
Collaborator

@Autumn1998 Autumn1998 commented Oct 10, 2025

  1. Decouple the dispatch/combine with buffer allocation, if dispatch required bigger space than the pre-allocated buffer, we will free the old buffers and allocate new.
  2. fix bug if no tokens received on the local rank.
  3. fix bug on trying to open handle from scale tensor on bf16
  4. Use None as default value instead of -1

@Autumn1998 Autumn1998 changed the title Fix bug on hybrid-ep Decouple the dispatch and buffer allocation on hybrid-ep Oct 13, 2025
@jershi425 jershi425 merged commit 1242eb4 into deepseek-ai:hybrid-ep Oct 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants