3 ms·
I'll second this. Clickhouse is amazing. I was actually using it today to query some CSV files. I had to refresh my memory on the syntax so if anyone is inte
by mightybyte 3y ago
I'll second this. Clickhouse is amazing. I was actually using it today to query some CSV files. I had to refresh my memory on the syntax so if anyone is interested:
clickhouse local -q "SELECT foo, sum(bar) FROM file('foobar.csv', CSV) GROUP BY foo FORMAT Pretty"
Way easier than opening in Excel and creating a pivot table which was my previous workflow.
Here's a list of the different input and output formats that it supports.
https://clickhouse.com/docs/en/interfaces/formats https://clickhouse.com/docs/en/interfaces/formats
- gkbrk 3y agoYou don't even need to use file() for a lot of things recently. These just work with clickhouse local. Even wildcards work. select * from `foobar.csv` or select * from `monthly-report-*.csv`
- mightybyte 3y agoOoh very nice, thanks for the tip!
- wwader 3y agoJust had to try: $ function _select_aux () { clickhouse local -q "SELECT $* FORMAT Pretty" } $ alias SELECT='noglob _select_aux' $ SELECT COUNT(*) as count FROM file('repos.json', JSON) ┏━━━━━━━┓ ┃ count ┃ ┡━━━━━━━┩ │ 30 │ └───────┘
- xk3 3y agoThis is very nice!! I went down the format clause[1] rabbit hole a couple minutes ago and it looks like they have `FORMAT Markdown` as an option. FORMAT PrettySpaceNoEscapes also looks a bit better than Pretty or the default PrettyCompact imho 1. https://clickhouse.com/docs/en/interfaces/formats https://clickhouse.com/docs/en/interfaces/formats
- Something1234 3y agoWhere's this noglob command coming from? I haven't heard of it before.
- wwader 3y agoAh sorry that is probably zsh specific, it makes sure to not glob expand * etc