Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add feature flag to enable heterogenous features #790

Open
varungup90 opened this issue Mar 4, 2025 · 0 comments
Open

Add feature flag to enable heterogenous features #790

varungup90 opened this issue Mar 4, 2025 · 0 comments

Comments

@varungup90
Copy link
Collaborator

🚀 Feature Description and Motivation

Right now heterogenous feature such as optimizer or request tracing is enabled by default. Enabling by default has two issues 1) It add small performance penalty 2) Requires to enable include_usage for streaming.

Goal here is to add a feature flag which can fix both issues. Along with feature flag add support for request tracing for streaming.

Use Case

GPU Optimizer

Proposed Solution

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant