Skip to content

Handle 503 #9

@pekatete

Description

@pekatete

Is it possible to add handling for a 503 error from a model when running a loop by automatically switching to another model rather than failing? e.g from pro to flash or flash-lite. Here's the output:

✕ [API Error: {"error":{"message":"{\n  \"error\": {\n    \"code\": 503,\n    \"message\": \"The model is overloaded. Please try again later.\",\n    \"status\": \"UNAVAILABLE\"\n
  }\n}\n","code":503,"status":"Service Unavailable"}}]

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions