4 ms·
you can also use pandas in Python to access parquet data, and then i.e. convert it to sqlite
by hackan 4y ago
you can also use pandas in Python to access parquet data, and then i.e. convert it to sqlite
- 0cf8612b2e1e 4y agoNaive pandas is going to limit you to RAM sizes when parquet is deliberately meant for huge datasets.
- FridgeSeal 4y agoAnyone reading who is currently using pandas and running into this issue-polars is generally faster, and now supports (still new though) out-of-core workloads.