You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To evaluate the router's performance, it would be useful to support distributed tracing. This would allow us to track the end-to-end latency from the router all the way to the vLLM inference, helping us identify the sources of latency.
I noticed the task for OpenTelemetry integration for tracing. I'd be happy to contribute to this effort if you're looking for support. Let me know if you'd like me to take it on.
To evaluate the router's performance, it would be useful to support distributed tracing. This would allow us to track the end-to-end latency from the router all the way to the vLLM inference, helping us identify the sources of latency.
Related: https://opentelemetry.io/docs/concepts/signals/traces/
The text was updated successfully, but these errors were encountered: