Failover for agent model provider #505
specialtactics
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I didn't see this in the docs, but I think it would be a good idea to be able to have a Failover model in the agent definition.
For example, if one provider is down or busy or maybe you've exhausted your limit, the SDK will then go and try the Failover provider and model.
Beta Was this translation helpful? Give feedback.
All reactions