3 ms·
may I ask, what is the value of using DuckDB vs loading data from parquet directly into pandas? Apart from the fact with duck db you can load part of data rathe
by art__friedman 2y ago
may I ask, what is the value of using DuckDB vs loading data from parquet directly into pandas? Apart from the fact with duck db you can load part of data rather than the entire file into memory?
- jeeeb 2y agoThe main value proposition is being able to query the data in SQL. Personally I find that more ergonomic than Pandas for a lot of tasks. It also works seamlessly with Pandas in Jupyter notebooks. You can query dataframes seamlessly and store query results back into dataframes for plotting etc.