Client tools concept?

[sunghoonkim-ms]

Hello :)

Our team is implementing the agent (in the cloud) for the shared device and most of tools are the client-side tools where the actual execution logic exists in the client so when the agent decides to call a tool, it's nothing but just return the tool call as is (run topped here).

Then, the application will take care of delivering to the client part.
Once the client executed the tool and has the tool result, it will pass the tool result to agent.

then the application will trigger new run with the tool result.

So, we need two things.

1. Agent should be able to return the tool call request as is in case the tool is defined as a client tool
2. Application should be able to request new agent run with tool result (not with user message)

OpenAI's implementation
https://openai.github.io/chatkit-js/guides/client-tools/

[stephentoub]

That all exists in Agent Framework. Can you elaborate on what's not working?

[sunghoonkim-ms]

I couldn't find a way to define AITool without the actual function block because the actual implementation is in the client side. I want AITool have only function name, description, and parameter.

Should I define it as "ApprovalRequiredAIFunction" and then intercept the tool call from MIddleware and then send to the client?

[stephentoub]

I want AITool have only function name, description, and parameter.

You can use AIFunctionFactory.CreateDeclaration, which accepts exactly name, description, and parameter schema (as well as an optional return schema).

If you have an AIFunction, you can also call AsDeclarationOnly on it.