[inference] add support for auto function calling mode
#208144
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
pgayvallet
added
release_note:skip
|
/ci |
pgayvallet
changed the title
auto native function calling modeauto function calling mode
|
/ci |
💔 Build Failed
Failed CI StepsHistory
|
pgayvallet
force-pushed
the
kbn-208143-inference-auto-FC
branch
from
f5f12ad to
35daba3
Compare
|
/ci |
dgieselaar
approved these changes
Jan 24, 2025
|
Starting backport for target branches: 8.x |
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Jan 24, 2025
) ## Summary Fix elastic#208143 Add a new value for the `functionCalling` parameter, `auto`, which is the new default. When `functionCalling=auto`, the system will detect if the underlying model/provider supports native function calling, and otherwise automatically fallback to simulated function calling. (cherry picked from commit c22b982)
💚 All backports created successfully
Note: Successful backport PRs will be merged automatically after passing CI. Questions ?Please refer to the Backport tool documentation |
kibanamachine
added a commit
that referenced
this pull request
Jan 24, 2025
…ode (#208144) (#208193) # Backport This will backport the following commits from `main` to `8.x`: - [[inference] add support for `auto` function calling mode (#208144)](#208144) <!--- Backport version: 9.4.3 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sqren/backport) <!--BACKPORT [{"author":{"name":"Pierre Gayvallet","email":"[email protected]"},"sourceCommit":{"committedDate":"2025-01-24T12:50:19Z","message":"[inference] add support for `auto` function calling mode (#208144)\n\n## Summary\r\n\r\nFix https://github.com/elastic/kibana/issues/208143\r\n\r\nAdd a new value for the `functionCalling` parameter, `auto`, which is\r\nthe new default.\r\n\r\nWhen `functionCalling=auto`, the system will detect if the underlying\r\nmodel/provider supports native function calling, and otherwise\r\nautomatically fallback to simulated function calling.","sha":"c22b9828a6551ea5205a025f1c5ace4046bdc66c","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","backport:version","v8.18.0"],"title":"[inference] add support for `auto` function calling mode","number":208144,"url":"https://github.com/elastic/kibana/pull/208144","mergeCommit":{"message":"[inference] add support for `auto` function calling mode (#208144)\n\n## Summary\r\n\r\nFix https://github.com/elastic/kibana/issues/208143\r\n\r\nAdd a new value for the `functionCalling` parameter, `auto`, which is\r\nthe new default.\r\n\r\nWhen `functionCalling=auto`, the system will detect if the underlying\r\nmodel/provider supports native function calling, and otherwise\r\nautomatically fallback to simulated function calling.","sha":"c22b9828a6551ea5205a025f1c5ace4046bdc66c"}},"sourceBranch":"main","suggestedTargetBranches":["8.x"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/208144","number":208144,"mergeCommit":{"message":"[inference] add support for `auto` function calling mode (#208144)\n\n## Summary\r\n\r\nFix https://github.com/elastic/kibana/issues/208143\r\n\r\nAdd a new value for the `functionCalling` parameter, `auto`, which is\r\nthe new default.\r\n\r\nWhen `functionCalling=auto`, the system will detect if the underlying\r\nmodel/provider supports native function calling, and otherwise\r\nautomatically fallback to simulated function calling.","sha":"c22b9828a6551ea5205a025f1c5ace4046bdc66c"}},{"branch":"8.x","label":"v8.18.0","branchLabelMappingKey":"^v8.18.0$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT--> Co-authored-by: Pierre Gayvallet <[email protected]>
pgayvallet
added a commit
that referenced
this pull request
Jan 27, 2025
… APIs (#208198) ## Summary Follow-up of #208144 The inference APIs can now detect if the underlying model / connector supports native function calling using the `functionCalling: "auto"` parameter. This PR adapts the calls done from the security assistant to use that new value Co-authored-by: Elastic Machine <[email protected]>
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Jan 27, 2025
… APIs (elastic#208198) ## Summary Follow-up of elastic#208144 The inference APIs can now detect if the underlying model / connector supports native function calling using the `functionCalling: "auto"` parameter. This PR adapts the calls done from the security assistant to use that new value Co-authored-by: Elastic Machine <[email protected]> (cherry picked from commit dc54c11)
JoseLuisGJ
pushed a commit
to JoseLuisGJ/kibana
that referenced
this pull request
Jan 27, 2025
) ## Summary Fix elastic#208143 Add a new value for the `functionCalling` parameter, `auto`, which is the new default. When `functionCalling=auto`, the system will detect if the underlying model/provider supports native function calling, and otherwise automatically fallback to simulated function calling.
JoseLuisGJ
pushed a commit
to JoseLuisGJ/kibana
that referenced
this pull request
Jan 27, 2025
… APIs (elastic#208198) ## Summary Follow-up of elastic#208144 The inference APIs can now detect if the underlying model / connector supports native function calling using the `functionCalling: "auto"` parameter. This PR adapts the calls done from the security assistant to use that new value Co-authored-by: Elastic Machine <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Fix #208143
Add a new value for the
functionCallingparameter,auto, which is the new default.When
functionCalling=auto, the system will detect if the underlying model/provider supports native function calling, and otherwise automatically fallback to simulated function calling.