Add metadata tables

[Fokko]

Feature Request / Improvement

In Iceberg Spark there are metadata tables that provide information around the table: https://iceberg.apache.org/docs/latest/spark-queries/

The most important tables are:

• Files assigned to @Gowthami03B, PR in Add Files metadata table #614
• Snapshots assigned to @Fokko in Add Snapshots table metadata #524
• History assigned to @ndrluis in Add history inspect table #828
• Metadata log entries @kevinjqliu (issue in [feat request] Add metadata_log_entries metadata table #594): Metadata Log Entries metadata table #667
• Manifests @geruh: PR in Add manifests metadata table #717
• Partitions assigned to @syun64 (issue in Support get partition table with filter #24)
• References assigned to @geruh in Add Refs metadata table #602
• Entries assigned to @Fokko in Add entries metadata table #551

[Gowthami03B]

@Fokko I can take a stab at this!

[Fokko]

@Gowthami03B That would be great, any specific one that you have in mind?

[Gowthami03B]

@Gowthami03B That would be great, any specific one that you have in mind?

Do we have a prio in mind? I jus saw your comments on #516, should we tackle Files first?

[Fokko]

SGTM, I'll do a first stab at the snapshots one 👍

[ndrluis]

@Fokko, could you assign the History table to me?

I was studying the Java implementation of the History table and noticed that we need some utility functions to handle the snapshot ancestors. We have a WIP task to implement them in this PR #533. Therefore, I believe it would be good to wait for the implementation

[Fokko]

@ndrluis certainly! 👍

[sungwy]

Hi @Fokko could I pick up the Partitions table?

[geruh]

Hey Fokko, I'll take references here ☝️

[Fokko]

@geruh Great seeing you here again. I've assigned it to you 👍

[rahil-c]

Hey @Fokko I can try working on Manifests table if no one is assigned it?
Update: Synced with @geruh offline who is already working on this item

[Fokko]

@Gowthami03B checking in if you're still interested in contributing the files table.

[Gowthami03B]

@Gowthami03B checking in if you're still interested in contributing the files table.

@Fokko yes, I will be sending over a PR shortly.

[Gowthami03B]

Can someone review this? @Fokko @HonahX @#614

[HonahX]

The last metadata table has been merged. Thanks everyone for all the great work and contributions. I think this issue can be closed