3 ms·
At what database size does it make sense to move from SQLite to DuckDB? My use case is off-line data analysis, not query / response web app.
by jgalt212 2y ago
At what database size does it make sense to move from SQLite to DuckDB? My use case is off-line data analysis, not query / response web app.
- wenc 2y agoIt's not so much about size but about usage pattern. If your workloads require fast writes and reads, SQLite will probably work fine. If you're looking to run analytic, columnar queries (which tend to involve a lot of aggregation and joins on a few columns (say less than 50) at a time), then DuckDB is way more optimized. Oversimplifying, Sqlite is more OLTP and DuckDB is more OLAP.
- chrisjc 2y agoProbably also worth mentioning that DuckDB can interact with SQLite dbs. https://duckdb.org/docs/extensions/sqlite.html https://duckdb.org/docs/extensions/sqlite.html https://duckdb.org/docs/guides/database_integration/sqlite.html https://duckdb.org/docs/guides/database_integration/sqlite.h... Thus potentially making duckdb an HTAP-like option.