How to set AllowConcurrentInvocation?

[itayfisz]

This property should allow the framework to execute tools concurrently.

In a simple flow which created ChatClientAgent - how do I set this property?

In SK, we could set this property as follows:

        return new AzureOpenAIPromptExecutionSettings
        {
            FunctionChoiceBehavior = FunctionChoiceBehavior.Auto(
                enabledFunctions,
                options: new FunctionChoiceBehaviorOptions
                {
                    AllowConcurrentInvocation = true // <<<
                }),
        };

In Agent Framework - I see this property exists in FunctionInvokingChatClient, but I don't know how do I initiate it when using ChatClientAgent.

[stephentoub]

Just to make sure, this is about wanting multiple tool calls requested by the model in the same response to be invoked concurrently (i.e. parallelism), right?

You can either:

a) Add your own FunctionInvokingChatClient to the IChatClient you pass to ChatClientAgent, configuring it however you want, e.g.

IChatClient client = ...;
client = client.AsBuilder().UseFunctionInvocation(...).Build();
... = new ChatClientAgent(client, ...);

The ChatClientAgent will see that the IChatClient already has a FunctionInvokingChatClient and will not add one of its own.

b) Ask the ChatClientAgent for its FunctionInvokingChatClient instance and configure it after the fact, e.g.

ChatClientAgent agent = ...;
FunctionInvokingChatClient? ficc = agent.GetService<FunctionInvokingChatClient>();
...; // set properties on `ficc`

[itayfisz]

Option (b) sounds good (assuming FunctionInvokingChatClient should always be registered).

Thanks!