If you need to stick with Python, Joblib is more reliable and works better than Multiprocessing in my experience. I ran into so many subtle quirks that needed

If you need to stick with Python, Joblib is more reliable and works better than Multiprocessing in my experience. I ran into so many subtle quirks that needed workarounds in Multiprocessing. Joblib.parallel with the Loky backend just seems to be Multiprocessing done right.