4 ms·
Visidata is wonderful. Also for querying large CSV and Parquet files, I use DuckDB. It has a vectorized engine and is super fast. It can also query SQLite file
by wenc 4y ago
Visidata is wonderful.
Also for querying large CSV and Parquet files, I use DuckDB. It has a vectorized engine and is super fast. It can also query SQLite files directly. The SQL support is outstanding.
https://duckdb.org/ https://duckdb.org/
Just have start the DuckDB REPL and start querying e.g.
Select * from ‘bob.CSV’ a
Join ‘Mary.parquet’ b
On a.Id = b.Id
Zips through multi GB files in a few seconds.
- michaelcampbell 4y agoIs the capitalized keywords a requirement? ew (IMO)
- wenc 4y agoNo, that’s an artifact of me typing on my phone. Also if you know SQL you’ll know that SQL keywords are case insensitive in most DBMSes. Don’t be too quick to ew.
- michaelcampbell 4y agoI was ew'ing at capitalized keywords, whether or not they're required. I'll be as quick as I like, thanks.
- wenc 4y agoYes and they’re not a requirement. Expressing premature disgust without investigation leads to low quality comments. You can do it but it goes against an ethos of curiosity and unfairly diminishes the object of discussion.