Skip to content

Add Telemetry support for AgentQnA using Grafana, Prometheus and Jaeger #1732

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Apr 3, 2025

Conversation

louie-tsai
Copy link
Collaborator

@louie-tsai louie-tsai commented Mar 31, 2025

Description

Enabling Telemetry by an additional compose.telemetry.yaml file.
By default, it is disabled.
it is only enabled by having compose.telemetry during docker compose up.
docker compose -f $WORKDIR/GenAIExamples/DocIndexRetriever/docker_compose/intel/cpu/xeon/compose.yaml -f compose.yaml -f compose.telemetry.yaml up -d

The PR enables Prometheus connections with Agent Microservices.

image

Then it could show different Agent statistics like react agent.
BTW, the dashboard name will be AgentQnA_MicroServices_Grafana instead.
image
SQL agent.
image
vLLM service
image
CPU statistics
image

Also add Telemetry tracing into ReactAgent Tools.py
image

Issues

1542.

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds new functionality)
  • Breaking change (fix or feature that would break existing design and interface)
  • Others (enhancement, documentation, validation, etc.)

Dependencies

Grafana, Prometheus, and Jaeger

Tests

Manually testing on Gaudi2

Copy link

github-actions bot commented Mar 31, 2025

Dependency Review

✅ No vulnerabilities or license issues found.

Scanned Files

@louie-tsai louie-tsai requested a review from ashahba March 31, 2025 23:40
@louie-tsai louie-tsai force-pushed the agent_telemetry branch 2 times, most recently from f33394f to 76b0ef2 Compare April 1, 2025 05:20
@louie-tsai louie-tsai requested a review from Spycsh April 1, 2025 05:20
@louie-tsai louie-tsai force-pushed the agent_telemetry branch 2 times, most recently from a1b467d to c127f91 Compare April 1, 2025 05:22
@louie-tsai louie-tsai added this to the v1.3 milestone Apr 1, 2025
@louie-tsai louie-tsai force-pushed the agent_telemetry branch 8 times, most recently from 867f77d to 9a2105c Compare April 2, 2025 15:33
Copy link
Contributor

@alexsin368 alexsin368 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

minor comments

@louie-tsai louie-tsai force-pushed the agent_telemetry branch 2 times, most recently from 7678919 to 91ac1d8 Compare April 2, 2025 23:44
@louie-tsai louie-tsai requested a review from ashahba April 2, 2025 23:46
Copy link
Collaborator

@ashahba ashahba left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@ashahba ashahba merged commit 11fa7d5 into opea-project:main Apr 3, 2025
16 checks passed
chyundunovDatamonsters pushed a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request May 16, 2025
…er (opea-project#1732)

Signed-off-by: louie tsai <[email protected]>
Signed-off-by: Tsai, Louie <[email protected]>
Signed-off-by: Chingis Yundunov <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants