4 ms·
What do you recommend for distributed data processing?
by gberger 6y ago
What do you recommend for distributed data processing?
- MrPowers 6y agoDask is a great alternative for distributed computing as well: https://github.com/dask/dask https://github.com/dask/dask IMO, Spark is better for some tasks and Dask is better for others.
- peteradio 6y agoFirst step is decide if you really need distributed data processing. I think this is the point author is making. I've seen GB sized data considered "BIG DATA" and its unbelievable the architectural patterns used to support this "BIG DATA".