Skip to content

Remove parquet arrow_cast dependency #9077

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
alamb merged 10 commits into from
Jan 9, 2026
Merged

Remove parquet arrow_cast dependency #9077

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
ef215f2
Cleanup parquet casting
tustvold Dec 31, 2025
75cca82
Cleanup dictionary writing
tustvold Dec 31, 2025
abd9c4b
Avoid unnecessary Date64 cast
tustvold Dec 31, 2025
40acd4c
Make casting explicit in PrimitiveArrayReader
tustvold Dec 31, 2025
968e7f7
Rework writer
tustvold Dec 31, 2025
ed43f81
Add dictionary packing
tustvold Dec 31, 2025
f2831a3
Remove broken test
tustvold Dec 31, 2025
b0bd4a4
Clippy
tustvold Dec 31, 2025
b2216d4
Merge branch 'main' into cleanup-casting
alamb Jan 7, 2026
1bfb373
Merge branch 'main' into cleanup-casting
alamb Jan 9, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions parquet/Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,6 @@ ahash = { version = "0.8", default-features = false, features = ["runtime-rng"]
[dependencies]
arrow-array = { workspace = true, optional = true }
arrow-buffer = { workspace = true, optional = true }
arrow-cast = { workspace = true, optional = true }
Copy link
Contributor

@alamb alamb Jan 5, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🎉

arrow-csv = { workspace = true, optional = true }
arrow-data = { workspace = true, optional = true }
arrow-schema = { workspace = true, optional = true }
Expand Down Expand Up @@ -91,6 +90,7 @@ lz4_flex = { version = "0.12", default-features = false, features = ["std", "fra
zstd = { version = "0.13", default-features = false }
serde_json = { version = "1.0", features = ["std"], default-features = false }
arrow = { workspace = true, features = ["ipc", "test_utils", "prettyprint", "json"] }
arrow-cast = { workspace = true }
tokio = { version = "1.0", default-features = false, features = ["macros", "rt-multi-thread", "io-util", "fs"] }
rand = { version = "0.9", default-features = false, features = ["std", "std_rng", "thread_rng"] }
object_store = { version = "0.12.0", default-features = false, features = ["azure", "fs"] }
Expand All @@ -104,7 +104,7 @@ default = ["arrow", "snap", "brotli", "flate2-zlib-rs", "lz4", "zstd", "base64",
# Enable lz4
lz4 = ["lz4_flex"]
# Enable arrow reader/writer APIs
arrow = ["base64", "arrow-array", "arrow-buffer", "arrow-cast", "arrow-data", "arrow-schema", "arrow-select", "arrow-ipc"]
arrow = ["base64", "arrow-array", "arrow-buffer", "arrow-data", "arrow-schema", "arrow-select", "arrow-ipc"]
# Enable support for arrow canonical extension types
arrow_canonical_extension_types = ["arrow-schema?/canonical_extension_types"]
# Enable CLI tools
Expand Down
Loading
Loading