feat: Plug and play system message tool frameworks #6874
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
More than half of the system message tools code can be plug and play with other ways to write/parse system message tools, such as the XML approach in the original PR.
Some models might do best with the XML or other approaches, or we might want to experiment with them. This PR pulls the tool codeblock format approach (```tool) into a plug and play
SystemMessageToolsFramework
, to allow easy other approaches later.Summary by cubic
Refactored the system message tools code to use a plug-and-play framework, making it easy to swap or add new tool codeblock formats like XML in the future.
SystemMessageToolsFramework
interface and a default implementation.