4 ms·
Why they didn't compare with Polars [0]? According to the h2oai benchmark [1], Polars is fast. [0] -- https://www.pola.rs/ https://www.pola.rs/ [1] -- https://
by wdroz 4y ago
Why they didn't compare with Polars [0]? According to the h2oai benchmark [1], Polars is fast.
[0] -- https://www.pola.rs/ https://www.pola.rs/
[1] -- https://h2oai.github.io/db-benchmark/ https://h2oai.github.io/db-benchmark/
- Tarq0n 4y agoPolars is for tabular data, a different kind of task.
- wdroz 4y agoBut you can read json from polars (or from pandas first then polars) then you can do the map/reduce/filter like in the benchmark.
- dmoura 4y agoThe initial idea was to focus on cmd line tools... I added pandas for comparison, as it is one of the most used libs to work with datasets. I will either remove Pandas from the equation or add Polars. By the way, I run some benchmarks and polars seems a bit faster than spyql for the aggregation challenge, but does not scale (loads everything into memory)