26 ms·
I personally tend to put all my data for analysis into clickhouse (which is written in C++ FWIW). My side project actually is all about ingesting JSON data into
by flurly 5y ago
I personally tend to put all my data for analysis into clickhouse (which is written in C++ FWIW). My side project actually is all about ingesting JSON data into clickhouse and making it super easy to query, visualize, monitor and alert on JSON data.
You certainly pay a computation cost everytime you want to scan the data, but I think the flexibility more than makes up for it. You can take a read about how and why I built GraphJSON here if you're interested https://www.graphjson.com/guides/about https://www.graphjson.com/guides/about
- qoega 5y agoHave you tried ClickHouse for dataset above? Interesting if it is faster or not
- zX41ZdbW 4y agoIt is appeared that clickhouse-local is faster than all of the rest, with a huge margin: https://colab.research.google.com/drive/1pGmfpNdGyzE1KEXDnSSiRgxQy9bcinGZ?usp=sharing https://colab.research.google.com/drive/1pGmfpNdGyzE1KEXDnSS...
- dmoura 4y agoYes, it is much faster, I will be updating the benchmark and reposting
- mritchie712 5y agoThis is awesome. Assuming you saw that 22.3 has a JSON column type? https://clickhouse.com/blog/clickhouse-22-3-lts-released/ https://clickhouse.com/blog/clickhouse-22-3-lts-released/ ps - we're built on Clickhouse at Luabase (https://luabase.com/ https://luabase.com/) and hiring across all role, send me a note (mike@luabase.com) if you're into web3+analytics.