3 ms·
This is very cool. I wonder if the Graphblas and the Dask team should collaborate. Dask has a production grade distributed computing system (that is cloud comp
by sandGorgon 7y ago
This is very cool. I wonder if the Graphblas and the Dask team should collaborate.
Dask has a production grade distributed computing system (that is cloud compatible with kubernetes, yarn, EMR, Dataproc,etc).
- lmeyerov 7y agoRAPIDS has picked up Dask for multi-gpu aspects of cudf (think spark/pandas on GPUs), and as cugraph is single GPU (https://github.com/rapidsai/cugraph https://github.com/rapidsai/cugraph) for going fast on ~billion row datasets... I'm guessing dask+cugraph will be happening for the next 100-1000X, if not already. Graph partitioning is a weird world, so will be interesting to see!