New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor pyarrow to look like fsspec #374

Draft

kevinjqliu wants to merge 1 commit into apache:main from kevinjqliu:kevinjqliu/consolidate-io

Contributor

kevinjqliu commented Feb 6, 2024 •

edited

Loading

Addresses #310 Consolidate FileIO

TODO:

Figure out what to do about HadoopFileSystem.from_uri(f"hdfs://{netloc}")
Get rid of parse_location
Pushdown similar function to io/__init__.py as much as possible


          refactor pyarrow

c85097e

Fokko added this to the PyIceberg 0.7.0 release milestone

sungwy modified the milestones: PyIceberg 0.7.0 release, PyIceberg 0.8.0 release

kevinjqliu modified the milestones: PyIceberg 0.8.0 release, PyIceberg 0.9.0 release

kevinjqliu removed this from the PyIceberg 0.9.0 release milestone

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet