6 ms·
I am a data scientists. I have used a lot of tools/libraries to interact with data. SQLite is my favorite. It is hard to beat the syntax/grammar. Also, when I
by flusteredBias 4y ago
I am a data scientists. I have used a lot of tools/libraries to interact with data. SQLite is my favorite. It is hard to beat the syntax/grammar.
Also, when I use SQLite I do not output using column mode. I pipe to `tv` (tidy-viewer) to get a pretty output.
https://github.com/alexhallam/tv https://github.com/alexhallam/tv
transparency: I am the dev of this utility
- samstave 4y ago
- flusteredBias 4y agohttps://github.com/alexhallam/tv#inspiration https://github.com/alexhallam/tv#inspiration
- flusteredBias 4y agoHere is an example of how I would pipe with headers to `tv`. sqlite3 :memory: -csv -header -cmd '.import taxi.csv taxi' 'SELECT passenger_count, COUNT(*), AVG(total_amount) FROM taxi GROUP BY passenger_count' | tv
- queuebert 4y agoWhat a nice tool. I love how Rust has reinvigorated command line utilities.
- corytheboyd 4y agopiping to jq (using json mode of course) also works well for this
- pdimitar 4y agoOr `jless`, which shows you a tree and doesn't flood your terminal.
- corytheboyd 4y agoNice, that's definitely better than `jq | less`
- ramraj07 4y agoJust want to add that snowflake (imo) is better. You don’t have to suffer SQLite’s lack of data types and honestly snowflake is the best tool to work with messy data. Just fyi you can set up a snowflake account with a minimum monthly fee of 25 bucks. It’ll be very hard to actually use 25 bucks if your data isn’t in 100s of GBs and you literally use as little compute as is needed so it’s perfect.
- humanistbot 4y agoThis is in no way a relevant good-faith reply. It is spam. A web-based cloud-based data analytics platform isn't in the same category as piping command-line programs together.
- ehvatum 4y agoWe can’t pay for anything that doesn’t have Jira integration, sorry!