Skip to content

[Bug]: Not exposing the structured outputs for Bedrock #2225

@DanCorvesor

Description

@DanCorvesor

Describe the bug

Bedrock LLM calling doesn't have the structured responses integrated - crucial for any agent building.
Bedrock doesn't support response format, we can see this log line in your code:
if "response_format" in kwargs and kwargs["response_format"] is not None: warnings.warn("response_format is not supported for Bedrock, it will be ignored.", UserWarning)
However, there is functionality in bedrock to have output schemas, see here aws.amazon.com/blogs/machine-learning/structured-data-response-with-amazon-bedrock-prompt-engineering-and-tool-use/
Please can you expose this through the bedrock wrapper ASAP as it's totally blocking for using ag2 with bedrock, thanks! (edited)

Steps to reproduce

No response

Model Used

No response

Expected Behavior

Expose the structured outputs in some way.

Screenshots and logs

No response

Additional Information

No response

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions