4 ms·
From https://iceberg.apache.org https://iceberg.apache.org > Iceberg is a high-performance format for huge analytic tables. How would that help speedup S3? Ge
by awiesenhofer 4y ago
From https://iceberg.apache.org https://iceberg.apache.org
> Iceberg is a high-performance format for huge analytic tables.
How would that help speedup S3? Genuine question?
- bushbaba 4y agoIceberg doesn’t use the directory structure to represent what objects belong to which table. The change allows objects to have significant entropy in the object keys prefix. This avoids hot spotting s3 and allows for greater bursts to s3 QPs.
- awiesenhofer 4y agoOh wow, thats neat! Thanks!