3 ms·
Have you tried the trick where you put CSV into SQLite? I do that. Many, maybe linked, CSVs. Load all into SQLIte, query, filter, sort, etc. In the repos to p
by djbusby 3y ago
Have you tried the trick where you put CSV into SQLite?
I do that. Many, maybe linked, CSVs. Load all into SQLIte, query, filter, sort, etc.
In the repos to process we have only scripts to load and filter. The SQLite things are short lived.
Also, memory only SQLite FTW!
- TristanBall 3y agoDuckdb does this straight from csv. You can treat them pretty much just like un-indexed tables, including queries, joins and output back to csv or parquet. its Really nice.