4 ms·
Since this is an article about speed and data processing on a Python blog, I'll just point out that the RiseLab team that created Ray and RLlib also has a libra
by blueyes 7y ago
Since this is an article about speed and data processing on a Python blog, I'll just point out that the RiseLab team that created Ray and RLlib also has a library called Modin, which is distributed Pandas. You just import modin as pd without changing the code: https://github.com/modin-project/modin https://github.com/modin-project/modin
- jszymborski 7y agoand in that vein, Dask: https://dask.org/ https://dask.org/
- marcinzm 7y agoIt will, however, from my reading convert the data to an actual pandas dataframe for certain operations. Which presumably is bad if your data doesn't fit into memory.