Skip to content

Write null counts in Parquet statistics when they are known to be zero #6502

Closed
@alamb

Description

@alamb

Describe the bug
The Rust parquet writer writes the thrift equivalent of None when the null count is zero rather than the thrift equivalent of Some(0)

This is inconsistent with the spec and other major implementations (Java and C++)

To Reproduce

Expected behavior
Write Some(0) when null count is known to be zero

Additional context
Part of #6256, but we split out the read/write changes into smaller PRs so adding a special issue here to track it / show up in the release notes

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementAny new improvement worthy of a entry in the changelogparquetChanges to the parquet crate

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions