hashjoiner

3 ms·

1. 1.▲
   by hashjoiner 3y ago

   Very interesting development :)
2. 2.▲
   by hashjoiner 5y ago

   DataFusion committee here. DuckDB can work on Arrow data, so I think it could coexist with DataFusion / Ballista quite well. I am not sure whether having different execution engines for Ballista is on the roadmap, but it's certain
3. 3.▲
   by hashjoiner 5y ago

   Yes, that's pretty exciting! There is even support in Polars to execute the dataframe compute in DataFusion (as it can handle larger than memory datasets).
4. 4.▲
   by hashjoiner 5y ago

   There is a PR from me (Daniël, committer) with for db-benchmark. For the group by benchmarks, on my machine, it is currently somewhat slower than the fastest (Polars). https://github.com/h2oai/db-benchmark/pull&#x2
5. 5.▲
   by hashjoiner 5y ago

   Happy for this release, and excited to contribute to this great query engine.
6. 6.▲
   Building a 32 core Kubernetes cluster for less than $1k(andygrove.medium.com)

   1 points by hashjoiner 5y ago|0 comments
7. 7.▲
   Increasing the level of parallelism in DataFusion 4.0(medium.com)

   1 points by hashjoiner 5y ago|0 comments
8. 8.▲
   Making joins faster in DataFusion based on table statistics(godatadriven.com)

   4 points by hashjoiner 6y ago|0 comments