4 ms·
If you want built-in GPU support (and distributed), you should check out cuNumeric (released by NVIDIA in the last week or so). Also avoids needing to manually
by eslaught 5y ago
If you want built-in GPU support (and distributed), you should check out cuNumeric (released by NVIDIA in the last week or so). Also avoids needing to manually specify chunk sizes, like it says in a sibling comment.
https://github.com/nv-legate/cunumeric https://github.com/nv-legate/cunumeric
- riyadparvez 5y agoI see they also have have pandas replacement: https://github.com/nv-legate/legate.pandas https://github.com/nv-legate/legate.pandas. How is it different from cuDF?
- eslaught 5y agoI believe cuDF is not distributed? If you use Legate Pandas (or any Legate libraries) you'll get distributed as well as GPU execution out of the box.
- hack_ml 5y agoYou can probably use https://github.com/rapidsai/cudf/tree/main/python/dask_cudf https://github.com/rapidsai/cudf/tree/main/python/dask_cudf a dask wrapper around cuDF.