Skip to content

Conversation

@anubhav756
Copy link
Contributor

@anubhav756 anubhav756 commented Oct 26, 2024

  • Load all tools using Toolbox
    • Remove the code that creates tools within the orchestration
  • Remove creation of ClientSession in the client app
    • Toolbox SDK handles this internally
    • Also remove it from the orchestrator's main class
    • Remove accompanying methods as well
  • Use bind_tools API to bind tools with the model
    • Remove information about tools from the prompt template
    • Also remove input/output formatting instructions and suffix
    • Remove code that creates AIMessage from the json formatted string response
  • Remove ToolMessage while inserting ticket to fix issue causing InvalidArgument error.
    • Also remove AI and human messages to further simplify the code.
  • Fix issue causing different messages to show up on decline ticket before and after page refresh.
    • We now return the actual response from the LLM instead of a hardcoded response in case of LangGraph.
  • Fix minor typos in the prompt prefix
  • Use LangGraph's prebuilt ToolNode
    • Remove code that creates custom ToolNode
  • Update frontend code to correctly parse query trace
    • Remove SQL from trace (currently not supported in Toolbox)
    • Fix CSS
  • Add dependency on toolbox-langchain
  • Remove unused imports

Diagram

image

Note

We need a running Toolbox service with a tools.yaml to load and invoke the tools now.

@anubhav756 anubhav756 self-assigned this Nov 11, 2024
@anubhav756 anubhav756 force-pushed the toolbox_sdk branch 2 times, most recently from 768823d to 5cf742a Compare November 15, 2024 11:13
@anubhav756 anubhav756 changed the base branch from main to ChatVertexAI November 15, 2024 12:43
@anubhav756 anubhav756 force-pushed the toolbox_sdk branch 4 times, most recently from 058d3f5 to 16be2f3 Compare November 15, 2024 23:47
@anubhav756 anubhav756 marked this pull request as ready for review November 18, 2024 21:12
@anubhav756 anubhav756 requested a review from a team as a code owner November 18, 2024 21:12
@anubhav756 anubhav756 requested a review from Yuan325 November 18, 2024 21:12
@anubhav756 anubhav756 marked this pull request as draft November 18, 2024 21:13
@anubhav756
Copy link
Contributor Author

/gcbrun

@anubhav756 anubhav756 closed this Jun 20, 2025
@anubhav756 anubhav756 deleted the toolbox_sdk branch June 20, 2025 14:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant