Difficulty using Embabel with Azure OpenAI through an internal GenAIHub #1134
Closed
huongle1512-commits
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I’m trying to use Embabel with Azure OpenAI through an internal GenAIHub gateway.
This gateway is OpenAI-compatible but requires a different authentication header (e.g., Ocp-Apim-Subscription-Key) instead of the usual Authorization: Bearer token.
I may be misunderstanding something, but from what I can see, OpenAiCompatibleModelFactory creates its own OpenAiApi instance with fixed RestClient/WebClient builders and a standard Bearer token. Since methods like createOpenAiApi() and chatModelOf() are not overridable, I haven't found a way to inject custom headers or provide my own HTTP client.
Is there an existing mechanism for customizing the OpenAiApi or its clients, or would it make sense to allow extension at this point?
Beta Was this translation helpful? Give feedback.
All reactions