4 ms·
Yes, you can use dask’s lower level APIs, like futures [0] or dask delayed, and it’ll just pickle the python objects. Dask provides a group of collections APIs,
by peterthehacker 6y ago
Yes, you can use dask’s lower level APIs, like futures [0] or dask delayed, and it’ll just pickle the python objects. Dask provides a group of collections APIs, like dataframes [1] and arrays that use more efficient serialization methods.
[0]https://docs.dask.org/en/latest/futures.html https://docs.dask.org/en/latest/futures.html
[1]https://docs.dask.org/en/latest/dataframe.html https://docs.dask.org/en/latest/dataframe.html