2 ms·
Oh. It's like Firecracker, only much faster 8-) What I like most is the ability to instantly reset the state of the VM to a known predefined state. It's like r
by nine_k 2y ago
Oh. It's like Firecracker, only much faster 8-)
What I like most is the ability to instantly reset the state of the VM to a known predefined state. It's like restarting the VM without any actual restart. It looks like an ideal course of action for network-facing services that are constantly under attack: even if an attack succeeds, the result is erased on the next request.
Easy COW page sharing for programs that are not written with that in mind, like ML model runners, is also pretty nice.
- chatmasta 2y agoIt also sounds ideal for resuming memory intensive per-user programs, like LLMs with a large context window. You can basically have an executable (and its memory) attached to a user session, but only pay the cost for it while the user session has an open request.
- dividuum 2y agoYes > TinyKVM can fork itself into copies that use copy-on-write to allow for huge workloads like LLMs to share most memory. As an example, 6GB weights required only 260MB working memory per instance, making it highly scalable.
- daralthus 2y agoyes that's the durable objects ~ durable agents model that cloudflare is building
- bonzini 2y agoIt's more like gVisor (or QEMU's user mode emulation but it does not support KVM, only dynamic code translation).