Feat/s3 fsspec#195

Closed

wumpus wants to merge 24 commits intowebrecorder:masterfrom

commoncrawl:feat/s3-fsspec

Commits on Jul 6, 2025

feat: add s3 support to extract and index
Greg Lindahl
committed
feat: also support http and https
Greg Lindahl
committed

Commits on Nov 19, 2025

Commits on Nov 21, 2025

Adding HTTP unit tests
malteos
committed

Commits on Jan 8, 2026

Fixed dependencies
malteos
committed

Commits on Jan 10, 2026

feat: tweaks to CI and docs
Greg Lindahl
committed

Commits on Jan 11, 2026

feat: S3 + HTTP integration including unit tests
wumpus
authored
feat: more generic install
Greg Lindahl
committed
fix: avoid moto s3fs clash over async
Greg Lindahl
committed
fix: needed dependencies
Greg Lindahl
committed