2 ms·
How do Parquet, Lance, and Nimble compare? lancedb/lance: https://github.com/lancedb/lance https://github.com/lancedb/lance : > Modern columnar data format fo
by westurner 3y ago
How do Parquet, Lance, and Nimble compare?
lancedb/lance: https://github.com/lancedb/lance https://github.com/lancedb/lance :
> Modern columnar data format for ML. Convert from Parquet in 2-lines of code for 100x faster random access, a vector index, data versioning, and more.
Compatible with pandas, DuckDB, Polars, and pyarrow
Can the optimizations in lance be ported to other formats without significant redesign?