Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support OpenAI style model input rather than relying on the model header #277

Closed
Jeffwan opened this issue Oct 8, 2024 · 1 comment
Closed

Support OpenAI style model input rather than relying on the model header #277

Jeffwan opened this issue Oct 8, 2024 · 1 comment
Assignees
@varungup90
Labels
area/gateway kind/enhancement New feature or request priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.
Milestone
v0.1.0-rc.4

Comments

@Jeffwan
Copy link
Collaborator

Jeffwan commented Oct 8, 2024

🚀 Feature Description and Motivation

This is a follow up story of #269

Right now, there's no guarantee user will pass mode in the HEADER. the OpenAI compatible API expect the model as part of the payload.

image

if we can not overcome this problem, user can not use openai sdk to call our service.

Use Case

No response

Proposed Solution

No response
@Jeffwan Jeffwan added kind/enhancement New feature or request area/gateway priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. labels Oct 8, 2024
@Jeffwan Jeffwan added this to the v0.1.0-rc.4 milestone Oct 8, 2024
@varungup90
Copy link
Collaborator

#290

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@varungup90 varungup90

Labels
area/gateway kind/enhancement New feature or request priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.
Projects
None yet
Milestone
v0.1.0-rc.4
Development

No branches or pull requests
2 participants
@Jeffwan @varungup90