2 ms·
As mentioned, for all but the simplest use-cases, you probably want to use Spark though. I think the time and energy that is spent on Dask would be better spen
by valenterry 5y ago
As mentioned, for all but the simplest use-cases, you probably want to use Spark though.
I think the time and energy that is spent on Dask would be better spent to get proper concurrency support into python.
- _Wintermute 5y agoIn the academic world you can run Dask on the typical clusters using slurm or grid-engine, without any additional setup. You're not going to get a university IT department to create a Spark cluster for you.