Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[s3] Allow usage of S3-Compatible endpoints #2758

Open
nanderson94 opened this issue Aug 20, 2024 · 1 comment · May be fixed by #2759
Open

[s3] Allow usage of S3-Compatible endpoints #2758

nanderson94 opened this issue Aug 20, 2024 · 1 comment · May be fixed by #2759
Labels
enhancement New feature or request

Comments

@nanderson94
Copy link

nanderson94 commented Aug 20, 2024

Problem Description

Many cloud providers and self-hosted object storage software utilize S3-compatible APIs which are compatible with boto3 with some extra configuration. Currently, those configuration options are not exposed to the users.

Proposed Solution

Pass-through options commonly utilized by S3-compatible endpoints:

  • An endpoint-url override, users may set this to https://ceph-rgw.example.com/ for example.
  • An option to select path-style bucket addressing as opposed to virtual-host

Alternatives

N/A

Additional Context

Rclone's documentation provides a good list of S3-compatible providers: https://rclone.org/s3/

@nanderson94 nanderson94 added the enhancement New feature or request label Aug 20, 2024
@nanderson94
Copy link
Author

Changes have been drafted in my fork: 379fe6c

@nanderson94 nanderson94 linked a pull request Aug 20, 2024 that will close this issue
11 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant