fix: enable thinking mode for DeepSeek V3.1 on Fireworks AI #10525
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Related GitHub Issue
Closes: #10071
Description
This PR attempts to address Issue #10071 by enabling thinking mode support for DeepSeek V3.1 on the Fireworks AI provider.
Changes:
supportsReasoningBinary: trueflag to thedeepseek-v3p1model definition in the Fireworks provider configurationHow it works:
When the model has
supportsReasoningBinary: trueand the user enables reasoning in the API options, the provider will passthinking: { type: "enabled" }parameter to the Fireworks API, which triggers the reasoning/thinking mode for DeepSeek V3.1.Feedback and guidance are welcome.
Test Procedure
cd src && npx vitest run api/providers/__tests__/fireworks.spec.ts- All 28 tests passedcd packages/types && npx tsc --noEmit- No type errorsPre-Submission Checklist
Documentation Updates
Additional Notes
This is a new PR as requested by @hannesrudolph. The fix adds the
supportsReasoningBinarycapability flag to DeepSeek V3.1 model based on user confirmation that Fireworks documentation supports thinking/reasoning mode for this model via API parameter.Important
Adds reasoning mode support to DeepSeek V3.1 model in Fireworks AI by setting
supportsReasoningBinary: true.supportsReasoningBinary: truetodeepseek-v3p1infireworks.tsto enable reasoning mode.thinking: { type: "enabled" }to Fireworks API.fireworks.spec.tsto check forsupportsReasoningBinary: trueindeepseek-v3p1model configuration.This description was created by
for 7e011e3. You can customize this summary. It will automatically update as commits are pushed.