3 ms·
Apache Iceberg is one of the emerging Open Table Formats in addition to Delta Lake and Apache Hudi [1]. [1] Open Table Formats: https://www.starburst.io/data-
by teleforce 2y ago
Apache Iceberg is one of the emerging Open Table Formats in addition to Delta Lake and Apache Hudi [1].
[1] Open Table Formats:
https://www.starburst.io/data-glossary/open-table-formats/ https://www.starburst.io/data-glossary/open-table-formats/
- jl6 2y agoThe table on that page makes it look like all three of these are very similar, with schema evolution and partition evolution being the key differences. Is that really it? I’d also love to see a good comparison between “regular” Iceberg and AWS’s new S3 Tables.
- benesch 2y agoYes, the three major open table formats are all quite similar. When AWS launched S3 Tables last month I wrote a blog post with my first impressions: https://meltware.com/2024/12/04/s3-tables https://meltware.com/2024/12/04/s3-tables There may be more in depth comparisons available by now but it’s at least a good starting point for understanding how S3 Tables integrates with Iceberg.
- jl6 2y agoCool, thank you. It feels like Athena + S3 Tables has the potential to be a very attractive serverless data lakehouse combo.
- Icathian 2y agoI think this mischaracterizes the state of the space. Iceberg is the winner of this competition, as of a few months ago. All major vendors who didn't directly invent one of the others now support iceberg or have announced plans to do so. Building lakehouse products on any table format but iceberg starting now seems to me like it must be a mistake.
- bdndndndbve 2y agoYeah working in the data space I see a ton of customers using Iceberg and some using Delta Lake if they're already a Databricks shop. Virtually no Hudi.