feat(puffin): Add PuffinWriter

[fqaiser94]

Part of #744

Summary

• Add PuffinWriter

Context

• This is the fifth of a number of PRs to add support for Iceberg Puffin file format.
• It might be helpful to refer to the overarching feat(puffin): Add reader and writer #714 from which these changes were split to understand better how these changes will fit in to the larger picture.
• It may also be helpful to refer to the Java reference implementation for PuffinWriter here.

[jonathanc-n]

@fqaiser94 Whats the current idea for this? I can offer help if needed.

[fqaiser94]

@fqaiser94 Whats the current idea for this? I can offer help if needed.

Forgot about this, let me try to revive this over the weekend

[fqaiser94]

cc: @Xuanwo @liurenjie1024

[Copilot]

Pull Request Overview

This PR introduces the PuffinWriter for writing Iceberg Puffin files with a focus on thread safety via a mutex lock for file writes. Key changes include:

• Implementation of the PuffinWriter with header and footer handling.
• Integration of blob compression and metadata tracking.
• Addition of tests to validate behavior across various scenarios.

Reviewed Changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.

File	Description
crates/iceberg/src/puffin/writer.rs	Introduces the new PuffinWriter and its API for writing blobs.
crates/iceberg/src/puffin/mod.rs	Registers the new writer module.

Comments suppressed due to low confidence (1)

crates/iceberg/src/puffin/writer.rs:196

• [nitpick] The test asserts on an exact error message string when add is called after closing. Consider using a dedicated error type or variant in order to make error matching more robust and less brittle.

assert_eq!( writer.add(blob_0(), CompressionCodec::None).await.unwrap_err().to_string(),

[liurenjie1024]

Thanks @fqaiser94 for this great pr, just some minor suggestions. Maybe we can remove the WriterState?

[liurenjie1024]

Thanks @fqaiser94 for this great pr, LGTM!