3 ms·

Thanks. That's more or less how I solved these problems too. And the questions are what I had to painstakingly answer myself at work. BTW, I haven't touched MP

Thanks. That's more or less how I solved these problems too. And the questions are what I had to painstakingly answer myself at work. BTW, I haven't touched MP in Py for couple of years now, but remember there's some misalignment in concurrent futures between pool.map and pool.submit. And for exceptions in background processes, I had a shared bool var called "emergency brake", and an error queue.

velosol 3y ago
I like "emergency brake" as a variable name! Glad to help, it was similar for me with a lot of effort to synthesize best practices and really appreciate all the concurrent options (asyncio, threads, MP) for where they each are valuable.