3 ms·
> logs, media, ML artifacts, raw dumps, etc., none of which fit into a table format. You would be appalled at the kind of stuff I have seen teams stuff into pa
by FridgeSeal 6mo ago
> logs, media, ML artifacts, raw dumps, etc., none of which fit into a table format.
You would be appalled at the kind of stuff I have seen teams stuff into parquet and iceberg tables.
- sagiba 6mo agoHa. The fact that teams reach for iceberg to organize things that aren't really tables is itself a symptom of needing better management tools for other types of data.
- FridgeSeal 6mo agoSure, but that’s not an S3 concern, because the vast majority of people use S3 as it is, without needing additional management machinery. The solution is just to spin up the machinery you need for your solution, rather than making S3 cover all possible bases.