-
Notifications
You must be signed in to change notification settings - Fork 525
Open
Labels
Description
Describe the bug
Updating .info file too frequently (1 request per second) triggered GCS object rate limit.
To Reproduce
Steps to reproduce the behavior:
- Start upload file faster than 1 request per second.
- See error
googleapi: Error 429: The rate of change requests to the object storage/8f3ffb04745ec523b4689ce083ee868d.info exceeds the rate limit. Please reduce the rate of create, update, and delete requests.
Expected behavior
Adding an exponential backoff / taking advantage of using object metadata to avoid rate limit error on updating .info file.
Antti