3 ms·
I was about to say the same thing. Multiprocessing on Python works great and isn’t even very hard if you use say async_apply with a Pool. Comparing single-thr
by malodyets 3y ago
I was about to say the same thing.
Multiprocessing on Python works great and isn’t even very hard if you use say async_apply with a Pool.
Comparing single-threaded Python with multiprocesssing in Language X is unfair if not disingenuous.
- mlyle 3y ago> Multiprocessing on Python works great and isn’t even very hard if you use say async_apply with a Pool. Multiprocessing works great if you don't really need a shared memory space for your task. If it's very loosely coupled, that's fine. But if you use something that can benefit from real threading, Python clamps you to about 1.5-2.5 cores worth of throughput very often.
- heavyset_go 3y agoThere's a serialization overhead both on dispatch and return that makes multiprocessing in Python unsuitable for some problems that would otherwise be solved well with threads in other languages.
- mirekrusin 3y agoUnless you don't need to change your code.