Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a demo to showcase new telemetry feature #933

Open
2 tasks
Tracked by #875
darthez opened this issue Jan 13, 2025 · 2 comments
Open
2 tasks
Tracked by #875

Create a demo to showcase new telemetry feature #933

darthez opened this issue Jan 13, 2025 · 2 comments
Assignees

Comments

@darthez
Copy link

darthez commented Jan 13, 2025

This issue is depends on #905. Once telemetry work is completed we would like to create a demo that illustrates the integration of a Membrane pipeline with a tool like Prometheus.

The expected outcomes of this work are:

@darthez darthez added this to Smackore Jan 13, 2025
@darthez darthez moved this to Todo in Smackore Jan 13, 2025
@darthez darthez mentioned this issue Jan 13, 2025
10 tasks
@wende wende moved this from Todo to In Progress in Smackore Feb 10, 2025
@wende
Copy link
Contributor

wende commented Feb 10, 2025

Using fly.io[0] there's already a Grafana/Prometheus stack inbuilt out of the box.
Although there is no way to add new data sources (like Grafana Tempo) which would allow for easier processing of Telemetry span formats [1], I was able to manually format data so that it is displayed in Grafana Tempo format (picture below)

Given how easy it is to consume telemetry data with libraries like prom_ex[2], I think this is the right way to go forward. At the same time it might allow us to be added to prom_ex available plugins list and gain some additional outreach quid pro quo

Prom_ex also aggregates the gathered telemetry data using telemetry_metrics[3], so it resolves the issue of having only raw data and no meaningful data aggregation.

Using the tools above should allow us to both demonstrate the features of Membrane.Telemetry as well as be somewhat familiar to an average Elixir developer due to the usage of rather popular tools (Fly.io, Prometheus, Grafana) being all industry-standard solutions

Image

@wende
Copy link
Contributor

wende commented Feb 17, 2025

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: In Progress
Development

No branches or pull requests

2 participants