3 ms·
For straightforward analytics queries, 20gb is well within what is possible to process on a single well specced machine. I would recommend storing the data on d
by RobinL 3y ago
For straightforward analytics queries, 20gb is well within what is possible to process on a single well specced machine. I would recommend storing the data on disk in parquet format and taking a look at duckdb or polars for processing it.
Obs this advice depends a bit on exactly the type of data, but as generic advice it's probably the simplest place to start
- boredemployee 3y agoSure, I forgot to say that it's tabular data. So I'm expecting to ingest data coming from dbs like postgresql/mysql, sql server, etc. Once the data is ingested, I'll make reports and dashboards. Probably will use metabase for that.