3 ms·
Do Fly Machines support POSIX/System V shared memory? It is a giant pain in the ass for us because lambda does not implement these shared memory mechanisms whic
by __turbobrew__ 4y ago
Do Fly Machines support POSIX/System V shared memory? It is a giant pain in the ass for us because lambda does not implement these shared memory mechanisms which many multiprocessing libraries use to communicate. Makes it hard to utilize multiple lambda cores when running python code. You need to use multiprocessing due to the python GIL, but most of the python multiprocessing IPC uses shared memory.
We managed to hack a solution which uses pipes for IPC but it would be nice not to have to do this.
- ignoramous 4y agoI haven't tried using shm on Fly, but I don't see why they'd not work. You could already run multiple processes in a guest vm [0] or run multiple guests vms on the same host [1]. If the guest kernel Fly boots your app into doesn't have required modules, I guess you could consider requesting (nerd-sniping 'em) specifically for those, like so: https://twitter.com/dave_universetf/status/1426221897407242246 https://twitter.com/dave_universetf/status/14262218974072422... [0] https://fly.io/docs/app-guides/multiple-processes/ https://fly.io/docs/app-guides/multiple-processes/ [1] https://community.fly.io/t/2316 https://community.fly.io/t/2316