feat(providers): add support for GitHub Models #755
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Refs: #522
📝 Description
This pull request introduces support for GitHub Models as a new LLM provider in Void. This directly addresses the request to use models provided by GitHub, allowing users on free or student plans to access and experiment with a variety of powerful AI models using their GitHub account for authentication.
The implementation leverages the existing OpenAI-compatible framework, making it a seamless and maintainable addition to the current provider architecture.
✨ Features Implemented
githubModelsProvider: A new provider has been added, configured to use the officialhttps://models.github.ai/inferenceendpoint.models:readpermissions in the settings. Clear instructions are provided in the UI.openai/gpt-4.1,deepseek/deepseek-r1,xai/grok-3) is included, along with their respective capabilities.429 Too Many Requestsstatus code. The system now provides user-friendly messages for different rate-limiting scenarios (per minute, per day, concurrent requests), guiding the user on how to proceed.🧪 How to Test
models:readscope.openai/gpt-4.1 (githubmodels)).429error and verify that the specific error message is displayed.✅ Contributor Checklist
Hey @animeshlego5 and @andrewpareles, I've implemented the support for GitHub Models as discussed in issue #522. This approach integrates with the existing OpenAI-compatible infrastructure and should be straightforward to review. Let me know your thoughts!