Regarding multiprocessing and serializing between processes in python, and linux specifically, have you tried SharredArray? It dumps numpy arrays in /dev/shm

Regarding multiprocessing and serializing between processes in python, and linux specifically, have you tried SharredArray? It dumps numpy arrays in /dev/shm which can loaded by other processes by the filepath, muuuuuch nicer than passing things around