8 ms·
LightVM – A new virtualization solution based on Xen
- detaro 9y agoIn case the ACM link isn't available to everyone, here is a copy hosted by NEC: http://cnp.neclab.eu/projects/lightvm/lightvm.pdf http://cnp.neclab.eu/projects/lightvm/lightvm.pdf
- michaelmior 9y agoIt would be nice if the mods could update to this link since it's accessible by anyone.
- sctb 9y agoThanks, we've updated the link from https://dl.acm.org/citation.cfm?id=3132763&CFID=824760366&CFTOKEN=64841666 https://dl.acm.org/citation.cfm?id=3132763&CFID=824760366&CF.... I'm not sure I've seen the ACM block traffic like that before.
- detaro 9y agoI believe the CFID in the URL is a user-specific token, and user-specific URLs shouldn't be fetched from all over the world, triggering the block.
- mapsnapps 9y agoIf I'm reading this right, that's pretty major. The isolation benefits of a VM with a bootspeed faster than docker?
- tyingq 9y agohttps://hypercontainer.io https://hypercontainer.io is also in this space. Doesn't boot as fast as docker, but faster than a normal VM.
- _joel 9y agoAlso Clear Containers from Intel - https://clearlinux.org/features/intel%C2%AE-clear-containers https://clearlinux.org/features/intel%C2%AE-clear-containers
- blixtra 9y agoRight, Clear Containers is a feature of both rkt and cri-o container runtimes. rkt has had that feature for a couple years, if I recall correctly.
- lbotos 9y agoI haven't been on the server side in a while, but 1) isn't Xen falling out of favor and 2) is docker boot speed a big problem?
- weberc2 9y agoBoot speed is a big selling point for Docker, but Docker's isolation story is poorer than a VM. If you can make a VM boot as quickly as Docker while preserving isolation, then Docker loses a big selling point.
- Philipp__ 9y agoIt’s called Zones (on illumos, prev. on Solaris)
- wise0wl 9y agoI'm a huge fan of Illumos and SmartOS and think that Zones + LX Branding are a far superior technology than the hodgepodge of cgroups + namespaces + userland container technology. HOWEVER---the amount of driver support in the OpenSolaris forks, the awful package management system, the ancient IPF system etcetera make it a non-starter for most environments. I have used SmartOS in production (along with the Triton ecosystem) and found it to be well thought out and compelling, albeit woefully immature and buggy. I think that these reasons, plus the EOL nature of Solaris "upstream", would easily put off most people in charge of making a long term technology commitment. I know it did for me.
- Philipp__ 9y agoWell, you are right, but remember how old SmartOS actually is... I kinda hope more people get it, and start investing into that amazing open source technology. I always liked BSDs and Solaris more than Linux (who I find really messy and chaotic).
- yjftsjthsd-h 9y agoSolaris as an upstream was dead long ago; Oracle stopped publishing source years before killing their own product. The heirs of opensolaris seem to have managed well enough
- wkz 9y agoWith the debugging benefits of a brick.
- weberc2 9y agoAs long as debugging isn't fundamentally incompatible with a unikernel approach, it's just a matter of maturity. And it's pretty silly to criticize a new, prospective technology for immaturity.
- wkz 9y ago> As long as debugging isn't fundamentally incompatible with a unikernel approach, it's just a matter of maturity. Well no, it's not "fundamentally" incompatible, it just doesn't seem very practical. And practicality matters IMHO. Maybe I'm missing something but it seems the debug mode of these systems would be very similar to how you debug a regular kernel. I.e. you have some GDB stub provided by your hypervisor. That might be fine for GDB, but what about all the tools to observe a running system? How would I ftrace, perf, strace, netstat, tcpdump, poke around in /proc and /sys etc? Sure there is noting stopping you from developing equivalent tools. But it's not very practical. Building a truly isolated container environment for Linux (something like Zones) would also give you isolation and provisioning speed, but you get to keep all your tooling.
- equalunique 9y agoTry it with the LING Erlang-on-Xen unikernel and see for yourself if it's not debugabble. Looks like they've got a solution for dubugging: https://twitter.com/erlang_on_xen/status/641628659657371648 https://twitter.com/erlang_on_xen/status/641628659657371648
- wkz 9y agoAgain, I'm not saying it can't be done. If Erlang+Xen=Debug then that's great. But if we're comparing unikernel-VMs to containers, my guess is that most users are after the "take my $LANG binary and concatenate it with half a Linux kernel"-workflow. And for that general case, most standard tools are off the table.
- est 9y agoMaybe faster than docker, but how about Intel's Clear Containers? https://lwn.net/Articles/644675/ https://lwn.net/Articles/644675/
- jeromegn 9y agoThe project's page: http://cnp.neclab.eu/projects/lightvm/ http://cnp.neclab.eu/projects/lightvm/
- metalliqaz 9y agoACM can't handle the Hacker News flood.
- sitkack 9y agoI have had temporary bans on the ACM for opening 8 papers in a new tab. ACM can't handle the me.
- metalliqaz 9y agoSounds like ACM needs to learn how to Internet.
- davidthewatson 9y agoHow is this different than zerovm? http://www.zerovm.org/ http://www.zerovm.org/
- deleted 9y ago[deleted]
- detaro 9y agoIt does not appear to be very similar at all.
- burgerdev 9y agoMaybe that ZeroVM is a NaCl sandbox, while LightVM is a Xen VM?
- xmichael99 9y agoZeroVM, thanks for the link. I wonder if this solves glibc type dependencies across platforms, it seems unclear.
- grabcocque 9y agoSo, unikernels?
- detaro 9y agoNo, not unikernels. They use unikernels and small linux builds for examples to show their improvement of Xen itself.
- citrin_ru 9y ago> We achieve lightweight VMs by using unikernels One problems with unikernels is a lack of debugging/tracing tools (like Dtrace/eBPF): https://www.joyent.com/blog/unikernels-are-unfit-for-production https://www.joyent.com/blog/unikernels-are-unfit-for-product...
- nickik 9y agoThat blog post is pretty crappy. See discussions here: https://news.ycombinator.com/item?id=10953766 https://news.ycombinator.com/item?id=10953766
- citrin_ru 9y agoThe blog post has some flawed arguments, but still there is almost no observability/tracing tools for unikernels.
- nickik 9y agoSome do, some don't. But to link to this as the 'super-argument' every-time somebody mentioned unikernels is pointless and wrong. Its also simply not relevant for many cases.
- equalunique 9y agoTry it with the LING Erlang-on-Xen unikernel and see for yourself if it's not debugabble. Looks like they've got a solution for dubugging: https://twitter.com/erlang_on_xen/status/641628659657371648 https://twitter.com/erlang_on_xen/status/641628659657371648
- contingencies 9y agoGreat job and nice to see Romania featuring in the news! To those who just spent the last two years retraining your teams and retooling your infrastructure explicitly for docker (who may show up in this thread embracing and enhancing with a large marketing budget shortly), do take this opportunity to learn the architectural and management/maintenance value of abstraction. ;)
- tinco 9y agoYou do realize that Docker containers have an abstract interface and can be run on all OCI runtimes right?
- bmitch3020 9y agoVM's tend to lose the overlay layered filesystem which can dramatically reduce disk usage. Having the filesystem reset to a clean state for every new container is a huge feature of containers. And VM's tend to need predefined dedicated resources for things like memory. A process in a container would only allocate memory when it needs and can free up for other processes to use. It's not all about the startup speed. That said, VM's have their place, and docker has the option to switch out backends. It's entirely possible to replace runc with some other tool that starts VM's instead of containers. (That's already happening today with Windows containers.)
- jpalomaki 9y ago>Having the filesystem reset to a clean state for every new container is a huge feature of containers. Could you use file system snapshots for this? Maybe also for the layers?
- mastax 9y agoIf it works for docker[1], it probably works for this. [1]: https://docs.docker.com/engine/userguide/storagedriver/zfs-driver/#how-the-zfs-storage-driver-works https://docs.docker.com/engine/userguide/storagedriver/zfs-d...
- tilpner 9y agoAn example for such an alternative backend would be runv, which can apparently be used with Docker (though I couldn't get it to work well, but that was probably just my fault) https://github.com/hyperhq/runv#run-it-with-docker https://github.com/hyperhq/runv#run-it-with-docker
- ConfucianNardin 9y agoThe Tinyx tool mentioned in the paper doesn't seem to be published anywhere. It doesn't help that the name was already in use (by a minimal X11 server).
- monocasa 9y agoXen is very much inspired by exokernels (you could even make the argument that it is an exokernel), so it makes sense that someone would push it more in that direction. That being said, if you're going to go that way,it's to bad that there isn't more inspiration from the past 20 years of OS design. A capability based security/object management interface would nice. I also really like Akaros's VM threads model; IMO that'll be the way we end up running what we currently call unikernels.
- Rusky 9y agoAkaros looks pretty interesting- the M:N aspect is certainly where I think we need to go.
- CalChris 9y agoit's to bad that there isn't more inspiration from the past 20 years of OS design. A capability based security/object management interface would nice. Agreed and seL4 comes to mind. It's capability based, quite fast and secure. For that matter, it's also quite small.
- robert_foss 9y agoTo save you some time, this is VMs + Unikernels.
- equalunique 9y agoUnikernels were my first thought. Thank you for the summary.
- detaro 9y agoIt's not an accurate summary though, see the sibling comment to yours for a better one.
- bildung 9y agoUnikernels are mentioned in passing, but are not the cause of the speedup. The main point of the paper is instead the introduction of "LightVM, a complete re-design of the basic Xen control plane optimized to provide lightweight virtualization".
- nwrk 9y agoSuper excited about this. Amazing progress. Kudos to authors.
- debpoulami_123 9y agoSuper excited about this. Amazing progress. Kudos to authors.