2 ms·
Parquet+iceberg stored on s3 as a base. That is solid enough. After that comes various kinds of caches, maybe postgres for frontend? Or something streaming? B
by fifilura 2y ago
Parquet+iceberg stored on s3 as a base. That is solid enough.
After that comes various kinds of caches, maybe postgres for frontend? Or something streaming?
But once everything is stored as files you gain the freedom to experiment or refactor.
- yfontana 2y agoIn many cases, that means gaining the freedom of creating a huge mess (speaking from experience)