4 ms·
This is cool...Totally reminded me about several tools pop up on HN every now and then in the past for similar task so i did a quick search: clickhouse-local -
by ebfe1 4y ago
This is cool...Totally reminded me about several tools pop up on HN every now and then in the past for similar task so i did a quick search:
clickhouse-local - https://news.ycombinator.com/item?id=22457767 https://news.ycombinator.com/item?id=22457767
q - https://news.ycombinator.com/item?id=27423276 https://news.ycombinator.com/item?id=27423276
textql - https://news.ycombinator.com/item?id=16781294 https://news.ycombinator.com/item?id=16781294
simpql- https://news.ycombinator.com/item?id=25791207 https://news.ycombinator.com/item?id=25791207
We need a benchmark i think..;)
- tanin 4y agoShameless plug. A desktop app: https://superintendent.app https://superintendent.app
- ebfe1 4y agowe need more shameless plug on this thread ... the more benchmark, the better! I think this would be a fun weekend afternoon :)
- tstack 4y agoOh, okay... https://lnav.org https://lnav.org is a log file viewer for the terminal that integrates with SQLite so you can use SQL to query your log files. No benchmarks, though.
- eirikbakke 4y agoAnother shameless plug, then: https://www.ultorg.com https://www.ultorg.com This one is another desktop app, with a slightly different approach: in the CSV file case, the data is parsed and dumped into a bundled PostgreSQL database, which you can then query with a visual query interface.
- wodenokoto 4y agoIt looks really nice. I’ve spend what feels like too much time looking for a windows app that I can use to occasionally preview CSV files before moving them into WSL. I just think $50/year is too much for occasional use. Since this posts has initiated several other shameless plugs, maybe I can swoop in and ask for shameless recommendations for something cheap in this space.
- tanin 4y agoThank you for your kind words. Could you elaborate your use case? Drop me an email at tanin@ superintendent.app, we should be able to work something out regarding pricing.
- sjellis 4y agoI am currently evaluating dsq and its partner desktop app DataStation. AIUI, the developer of DataStation realised that it would be useful to extract the underlying pieces into a standalone CLI, so they both support the same range of sources. dsq CLI - https://github.com/multiprocessio/dsq https://github.com/multiprocessio/dsq DataStation desktop app - https://datastation.multiprocess.io/ https://datastation.multiprocess.io/ Two alternative CLI tools that I looked at: sq - https://sq.io/ https://sq.io/ octosql - https://github.com/cube2222/octosql https://github.com/cube2222/octosql Honourable mentions to: Miller - https://miller.readthedocs.io/en/latest/index.html https://miller.readthedocs.io/en/latest/index.html Dasel - https://daseldocs.tomwright.me/ https://daseldocs.tomwright.me/ These don't use SQL. VisiData is also amazing for data navigation, although it requires some effort to get the model: https://www.visidata.org/ https://www.visidata.org/
- alserio 4y agoxsv is invaluable for processing big csv files: https://github.com/BurntSushi/xsv https://github.com/BurntSushi/xsv
- antman 4y agoGroupby and joins are a good test. You could also give Duckdb cli api a try (it is column based)
- deleted 4y ago[deleted]
- marklit 4y agoI'll save you the trouble, ClickHouse will come up on top by a mile and is the only one listed that supports clustering and spill to disk.
- mattewong 4y agoanother shameless plug: https://github.com/liquidaty/zsv https://github.com/liquidaty/zsv