4 ms·

We're about to evaluate it since it's incubating now in AWS' EMR. I think if you have existing spark workloads that require update or delete of existing data s

We're about to evaluate it since it's incubating now in AWS' EMR. I think if you have existing spark workloads that require update or delete of existing data stored in parquet, then it might be a good choice since it fills in a major gap there. The other choice is Delta Lake which provides similar capability.

xyzzy_plugh 6y ago
I believe Netflix's Iceberg (now also Apache) aims to solve the same problems.
- hashhar 6y ago
  Iceberg solves more problems than what Hudi does. The biggest win is computed partitions and not having to define a strict partitioning strategy from the start.
- sub3421 6y ago
  Unlike hudi and delta lake, iceberg does not support updates/deletes yet.