2 ms·
Booting 10K Serverless Functions Within One Second via RDMA-Based Remote Fork
- belter 5y ago"...We present MITOSIS, an OS primitive to support fast remote fork with minimal resource provisioning for serverless computing. MITOSIS is the first to fork over 10,000 new containers from only one instance across multiple machines within a second. It also allows transparent and efficient intermediate data sharing between producer and consumer serverless functions even across machines. The key enabler for this high speed is an RDMA-OS co-design, which imitates local fork with RDMA’s remote memory read capability bypassing extra software overhead for starting and running containers. We also introduce techniques for lightweight connection and memory management based on advanced RDMA transport and fast containerization in a distributed setting. We have implemented MITOSIS on Linux and integrated it to FN, a popular serverless computing framework...." [PDF]: https://arxiv.org/pdf/2203.10225.pdf https://arxiv.org/pdf/2203.10225.pdf FN: https://fnproject.io/ https://fnproject.io/ RDMA: A network feature that allows direct access to the memory of a remote computer: https://www.usenix.org/system/files/conference/atc16/atc16_paper-kalia.pdf https://www.usenix.org/system/files/conference/atc16/atc16_p...