fix(llm-proxy): let endpoint aliases diverge while a group converges warn instead of block - #19422
Open
araffass wants to merge 1 commit into
Open
fix(llm-proxy): let endpoint aliases diverge while a group converges warn instead of block#19422araffass wants to merge 1 commit into
araffass wants to merge 1 commit into
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Issue
https://gravitee.atlassian.net/browse/APIM-15005
Description
On an endpoint group holding two or more LLM provider endpoints, an alias could never be introduced after creation. The same invariant — all endpoints must carry the same alias set — was enforced twice: the console blocked the edit-endpoint form, and the management API rejected the whole update with 400 api.endpointsGroup.llm-proxy.provider.mismatch. Since every client edits one endpoint at a time, the divergent intermediate state is unavoidable, so no sequence of saves could ever reach consistency; the only workaround was recreating the group. Shared aliases are what makes cross-provider failover work, so this blocked that setup entirely (APIM-15000, REWE POC).
The invariant is unnecessary at runtime: the gateway only routes an alias to the endpoints that declare it, and a failover rotation skips an endpoint lacking the requested alias. So:
Groups whose aliases already match see no change. Tests: alias introduction on an alias-less group is saveable with the warning shown; aligning the second endpoint clears it live; matching groups show nothing; backend suite accepts diverging aliases and drops the obsolete parse-failure test.
Additional context