3 ms·
One thing to remember about ProcessPoolExecutor is that parameters and return values are pickled (serialized/deserialized) in order to communicate with other Py
by theandrewbailey 7y ago
One thing to remember about ProcessPoolExecutor is that parameters and return values are pickled (serialized/deserialized) in order to communicate with other Python processes. Subinterpreters (PEP 554) aims to alleviate this.
https://www.python.org/dev/peps/pep-0554/ https://www.python.org/dev/peps/pep-0554/
- auraham 7y agoHow can I determine whether a function can be pickled? A few months ago, I developed a concurrent system using ProcessPoolExecutor. In that case, the function made use of numpy, scipy, and some instaces of classes. I worked as expected, but I am not sure if that function was pickable.