3 ms·

Recently discovered ray.io. Beats multiprocessing and can integrate with dask.

• spicyramen 5y ago
  What's your experience with Ray
  • mrfox321 5y ago
    Ray is awesome and magical. You can build really ergonomic distributed programs that are small wrappers around python classes. I would prefer this to multiprocessing even if you are only on a single host.
    • thenipper 5y ago
      I’ll totally second this. It takes away a lot of the tedium of multiprocessing programming. I implemented it at my last job and it was a game changer. Simplified a lot of gnarly cluster management and let me focus on my code rather then figuring out how to distribute the work.
• gjvc 5y ago
  YMMV. dask with ray is 10% slower than dask with multiprocessing ray on my workload.
• deleted 5y ago
  [deleted]