4 ms·
We use DuckDB extensively where I work (https://watershed.com https://watershed.com), the primary way we're using it is to query Parquet formatted files stored
by bigdubs 4y ago
We use DuckDB extensively where I work (https://watershed.com https://watershed.com), the primary way we're using it is to query Parquet formatted files stored in GCS, and we have some machinery to make that doable on demand for reporting and analysis "online" queries.
- dstroot 4y agoStoring data in Parquet files and querying via DuckDB is fast and kind of magical.
- mritchie712 4y agoDo you load the Parquet files in duckdb or just query them directly?
- bigdubs 4y agoWe query them directly in most cases with the httpfs plugin, but for hot paths we fetch them and cache them on disk locally.