3 ms·
This entire stack also now exists for arrays as well as for tabular data. It's still S3 for storage, but Zarr instead of parquet, Icechunk instead of Iceberg, a
by tomnicholas1 2y ago
This entire stack also now exists for arrays as well as for tabular data. It's still S3 for storage, but Zarr instead of parquet, Icechunk instead of Iceberg, and Xarray for queries in python.
- datancoffee 2y agonice pointer. Thanks! putting Zarr/icechunk/xarray into my weekend projects queue.
- deleted 2y ago[deleted]