Skip to content

[amazon_bedrock_agentcore] add gateway_application_logs data stream #15991 #16587

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
gpop63 wants to merge 9 commits into
base: main
Choose a base branch
from
Open

[amazon_bedrock_agentcore] add gateway_application_logs data stream #15991 #16587

gpop63 wants to merge 9 commits into from

Conversation

@gpop63
Copy link
Contributor

@gpop63 gpop63 commented Dec 16, 2025 •
edited
Loading

Overview

This PR adds the gateway_application_logs data stream.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.
  • I have verified that any added dashboard complies with Kibana's Dashboard good practices

Author's Checklist

  • [ ]

How to test this PR locally

Related issues

  • Closes elastic/obs-integration-team/issues/699

Screenshots

@gpop63 gpop63 self-assigned this Dec 16, 2025
@gpop63 gpop63 added Team:Obs-InfraObs Observability Infrastructure Monitoring team [elastic/obs-infraobs-integrations] Integration:aws_bedrock_agentcore Amazon Bedrock AgentCore enhancement New feature or request labels Dec 16, 2025
@elastic-vault-github-plugin-prod
Copy link

elastic-vault-github-plugin-prod bot commented Dec 16, 2025

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

@gpop63 gpop63 marked this pull request as ready for review December 17, 2025 15:45
@gpop63 gpop63 requested a review from a team as a code owner December 17, 2025 15:45
agithomas
agithomas reviewed Dec 19, 2025
View reviewed changes
packages/aws_bedrock_agentcore/data_stream/gateway_application_logs/fields/fields.yml Outdated
type: keyword
description: ID of the processed request.

- name: body
Copy link
Contributor

@agithomas agithomas Dec 19, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For the agentcore runtime application log request_payload_object is used as the field name for the flattened field. Can a similar naming convention be followed here, such as payload_object ?

agithomas
agithomas reviewed Dec 19, 2025
View reviewed changes
...way_application_logs/_dev/test/pipeline/test-aws-bedrock-agentcore-gateway.log-expected.json
"body": {
"id": "7",
"isError": false,
"log": "Processing request for tool DocumentRetrieval___fetch_order_details from target XYZPROD001"
Copy link
Contributor

@agithomas agithomas Dec 19, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we extract the key parts of this and store them in ECS fields?

Copy link
Contributor Author

@gpop63 gpop63 Dec 21, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The body.log field does not always follow a consistent format. In some cases, we may be able to extract values such as the tool name and target but these fields will not be present in all gateway logs.

Copy link
Contributor

@agithomas agithomas Dec 22, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For the gateway, the tool operation name, target, and outcome of the tool operation (including target invocation results) are important observability information. When present, let's capture it and store them.

Copy link
Contributor

@agithomas agithomas Dec 22, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also, you may store the log data entirely in the messsage field

@elasticmachine
Copy link

elasticmachine commented Jan 5, 2026

💚 Build Succeeded

History

cc @gpop63

agithomas
agithomas approved these changes Jan 7, 2026
View reviewed changes
Copy link
Contributor

@agithomas agithomas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@andrewkroh andrewkroh added the documentation Improvements or additions to documentation. Applied to PRs that modify *.md files. label Jan 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@agithomas agithomas agithomas approved these changes

Assignees

@gpop63 gpop63

Labels

documentation Improvements or additions to documentation. Applied to PRs that modify *.md files. enhancement New feature or request Integration:aws_bedrock_agentcore Amazon Bedrock AgentCore Team:Obs-InfraObs Observability Infrastructure Monitoring team [elastic/obs-infraobs-integrations]

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@gpop63 @elasticmachine @agithomas @andrewkroh