-
Notifications
You must be signed in to change notification settings - Fork 502
Description
Describe the bug
Bedrock LLM calling doesn't have the structured responses integrated - crucial for any agent building.
Bedrock doesn't support response format, we can see this log line in your code:
if "response_format" in kwargs and kwargs["response_format"] is not None: warnings.warn("response_format is not supported for Bedrock, it will be ignored.", UserWarning)
However, there is functionality in bedrock to have output schemas, see here aws.amazon.com/blogs/machine-learning/structured-data-response-with-amazon-bedrock-prompt-engineering-and-tool-use/
Please can you expose this through the bedrock wrapper ASAP as it's totally blocking for using ag2 with bedrock, thanks! (edited)
Steps to reproduce
No response
Model Used
No response
Expected Behavior
Expose the structured outputs in some way.
Screenshots and logs
No response
Additional Information
No response