4 ms·
This makes more sense. I still wonder if the author isn't just effectively recreating Apache Iceberg manually here.
by vovavili 7mo ago
This makes more sense. I still wonder if the author isn't just effectively recreating Apache Iceberg manually here.
- tomrod 7mo agoAre they paying for the repo space, I wonder?
- cyanydeez 7mo agosomeones paying to keep name dropping Iceberg(tm)
- mulmen 7mo agoWeird accusation. Iceberg is an Apache project. I don’t think anyone gets paid when you use it so not sure what the benefit of shilling would be. It is just a table format that’s well suited for this purpose. I would expect any professional to make a similar recommendation.
- tamnd 7mo agoI intentionally kept it lightweight. Just Parquet files + simple partitioning + commits on Hugging Face. That already covers most of what I need, without introducing a heavier stack or extra dependencies. Also, I wanted something that is easy to consume anywhere. With this setup, you can point DuckDB or Polars directly at the data and start querying, no catalog or special tooling required.