4 ms·

Managing processes is more annoying than threads, though. Incl. data passing and so forth.

• pillusmany 3y ago
  The "ray" library makes running python code on multi core and clusters very easy.
  • smcl 3y ago
    Interesting - looking at their homepage they seem to lean heavily into the idea that it's for optimising AI/ML work, not multi-process generally.
    • pillusmany 3y ago
      You can use just ray.core to do multi process. You can do whatever you want in the workers, I parse JSONs and write to sqlite files.
  • kroolik 3y ago
    Although its great the library helps with multicore Python, the existence of such package shouldnt be an excuse not to improve the state of things in std python