3 ms·
uhm why would you ever use this instead of sqlite
by Woshiwuja 2y ago
uhm why would you ever use this instead of sqlite
- maleldil 2y agoDuckDB is optimised for analytical tasks, whereas SQLite isn't.
- ayhanfuat 2y agoFor those not aware: analytical tasks involve a lot of groupings, aggregations, running sums/averages, sorting, ranking etc. Columnar databases like duckdb are more focused on those tasks so you can do these tasks much faster.
- Woshiwuja 2y agoTy! Never got into the analytics side of things
- belter 2y agoHave a look at this section of the AWS Redshift documentation (also a columnar database) to understand the advantages of these types of systems: https://docs.aws.amazon.com/redshift/latest/dg/c_columnar_storage_disk_mem_mgmnt.html https://docs.aws.amazon.com/redshift/latest/dg/c_columnar_st... Or the advantage of columnar file formats, like ORC or Parquet, for analytical queries. Normally you are only interested in a few columns.
- PartiallyTyped 2y agoColumnar formats allow for some pretty interesting optimizations with respect to filtering by rewriting and pushing down constraints / checks; and evaluating multiple of them simultaneously, pulling as little as necessary.