2 ms·
Use an analytic database with column storage. Even on modest hardware they can insert millions of rows per second in a variety and query hundreds of millions pe
by hodgesrm 4y ago
Use an analytic database with column storage. Even on modest hardware they can insert millions of rows per second in a variety and query hundreds of millions per second. They are ideal for exploring data.
MySQL by contrast is ideal for transaction processing, which is a very different problem.
I work on ClickHouse so I'm going to recommend that. It's open source and runs on everything from laptop to Kubernetes to cloud. There are multiple cloud services for ClickHouse as well, if you don't wnat to run it yourself. If you want to use ClickHouse have a look at the Altinity Quickstart for ClickHouse video on Youtube to learn how it works. [0]
[0] https://www.youtube.com/watch?v=phTu24qCIw0 https://www.youtube.com/watch?v=phTu24qCIw0
I work at Altinity and did the video. There are also many other great analytic databases beside ClickHouse, including: Snowflake, BigQuery, Druid, and Redshift.