Skip to content

Conversation

@yannicks1
Copy link
Collaborator

[CB] add warning when exceeding 32K context length

Warn the user that we do only support 32K context length as of now. Requesting more might still compile, but is untested ground.

@github-actions
Copy link

👋 Hi! Thank you for contributing to vLLM support on Spyre.
Just a reminder: Make sure that your code passes all the linting checks, otherwise your PR won't be able to be merged. To do so, first install the linting requirements, then run format.sh and commit the changes. This can be done with uv directly:

uv sync --frozen --group lint --active --inexact

Or this can be done with pip:

uv pip compile --group lint > requirements-lint.txt
pip install -r requirements-lint.txt
bash format.sh

Now you are good to go 🚀

Co-authored-by: Wallas Henrique <[email protected]>
Signed-off-by: Yannick Schnider <[email protected]>
@yannicks1 yannicks1 enabled auto-merge (squash) August 15, 2025 14:39
@github-actions github-actions bot added the ready label Aug 15, 2025
@yannicks1 yannicks1 merged commit fbbd54c into main Aug 15, 2025
24 checks passed
@yannicks1 yannicks1 deleted the ysc-add-warning-contextl-length branch August 15, 2025 14:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants