Check out Magnitude, we built it to solve that problem: https://github.com/plasticityai/magnitude https://github.com/plasticityai/magnitude It's still loaded f

Check out Magnitude, we built it to solve that problem: https://github.com/plasticityai/magnitude https://github.com/plasticityai/magnitude It's still loaded from a file, but heavily uses memory-mapping and caching to be speedy and not overload your RAM immediately. And in production scenarios, multiple worker processes can share that memory due to the memory mapping. Granted it's read-only, so might not be exactly what you are looking for. Disclaimer: I'm the author.