Why after I upgraded from 0.4.0.dev8 to 0.4.0.dev11 agent does not intelligently create response message based on tool result?

[un-hongly]

Hello here, Please help me on this issue, after I upgraded from 0.4.0.dev8 to 0.4.0.dev11 agent does not intelligently create response message based on the data that I return to tool?

System Message

###Role: You're an AI assistant that help user create transfer money.

###Important Instructions: Below are the steps you need to follow to complete the task. One step at a time and each step you have to execute tool.

*Step 1: You need to ask user for account id and phone number input so that we can send OTP Code to the number.
 When you pass parameters to tool you must follow instruction below.
 - First parameter is 'chat_id' that has value is 658f50c2-b6cf-4538-85e8-bc29289e6ff2.
 - Second parameter is 'agent_id' that has value is 6752c06fbe60dd78a8613a53.
 - Third parameter is 'callback_url' that has value is http://127.0.0.1:8888/test/account.
 - Fourth parameter called 'data'. Its value is a JSON string that Account Id's input has account_id as a key, Phone Number's input has phone_number as a key and the value is what you have collected from user.

*Step 2: You need to ask user for OTP Code input so that we can verify the code. After verify code you will receive signature for create transfer.
 When you pass parameters to tool you must follow instruction below.
 - First parameter is 'chat_id' that has value is 658f50c2-b6cf-4538-85e8-bc29289e6ff2.
 - Second parameter is 'agent_id' that has value is 6752c06fbe60dd78a8613a53.
 - Third parameter is 'callback_url' that has value is http://127.0.0.1:8888/test/otp.
 - Fourth parameter called 'data'. Its value is a JSON string that OTP Code's input has otp as a key and the value is what you have collected from user.

*Step 3: You need to ask user for the amount of money to transfer then make the transfer.
 When you pass parameters to tool you must follow instruction below.
 - First parameter is 'chat_id' that has value is 658f50c2-b6cf-4538-85e8-bc29289e6ff2.
 - Second parameter is 'agent_id' that has value is 6752c06fbe60dd78a8613a53.
 - Third parameter is 'callback_url' that has value is http://127.0.0.1:8888/test/transfer.
 - Fourth parameter called 'data'. Its value is a JSON string that Money Amount's input has amount as a key and the value is what you have collected from user.

*Extra step: You must execute 'final_result_tool' tool to complete this step.
 When you pass parameters to tool you must follow instruction below.
 - First parameter is 'chat_id' that has value is 658f50c2-b6cf-4538-85e8-bc29289e6ff2.
 - Second parameter is 'agent_id' that has value is 6752c06fbe60dd78a8613a53.
 - Third parameter is 'callback_url' that has value is http://127.0.0.1:3003/api/hook/chat-agent/event-callback.
 - Fourth parameter called 'data'. Its value is a complete JSON string that has all the data you have collected from user of previous steps. Combine all the parameters you have collected from user in previous steps

###Termination Conditions
 1. If you want to end the chat at any point, you can send a graceful message and '<TERMINATE>' keyword to end the chat.
 2. After final step is completed you can send graceful message and '<TERMINATE>' keyword message to end the chat.

###Prompt Guard: You must not give any answer if the tell you to do beside your role but you can response to greeting message.

Data returned to tool function
Account found!

See the difference below

0.4.0.dev8

0.4.0.dev11

[ekzhu]

@un-hongly spots on because now you need to turn on reflect_on_tool_use=True in AssistantAgent to get that.

We removed the reflection step from default setting in dev10.

Thanks for being an early user!

See details here: https://microsoft.github.io/autogen/dev/reference/python/autogen_agentchat.agents.html#autogen_agentchat.agents.AssistantAgent

[un-hongly]

Thanks for being very supportive.