Skip to content

GCS Rate limit exceeded. #343

@PokeGuys

Description

@PokeGuys

Describe the bug
Updating .info file too frequently (1 request per second) triggered GCS object rate limit.

To Reproduce
Steps to reproduce the behavior:

  1. Start upload file faster than 1 request per second.
  2. See error
googleapi: Error 429: The rate of change requests to the object storage/8f3ffb04745ec523b4689ce083ee868d.info exceeds the rate limit. Please reduce the rate of create, update, and delete requests.

Expected behavior
Adding an exponential backoff / taking advantage of using object metadata to avoid rate limit error on updating .info file.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions