6 ms·
There's likely many more of these. As a reminder, Linux has millions of lines of code, and all of them run with supervisor privileges. This is not a good arch
by snvzz 5y ago
There's likely many more of these.
As a reminder, Linux has millions of lines of code, and all of them run with supervisor privileges.
This is not a good architecture. Generally, you'd try to minimize the attack surface.
Multiserver, microkernel systems based on capabilities is where it's at.
seL4 is the better microkernel to build such a system on.
- athrowaway3z 5y agoThere exist people who own their own hardware and are not providing an API to run arbitrary code. If they get together and build an OS they are generally more interested in throughput than security models. Both have pro's and con's but the fact is: one is more popular with the "just get something working" crowd for better and worse.
- VWWHFSfQ 5y agoIt's my understanding that the microkernel architecture is slow. Nearly unusably slow. And that's why nobody uses it. Am I off-base? I'm interested!
- dijit 5y agoYes, it’s going to be slower All of those security checks between components and memory passing will cause it to be slower. But that doesn’t mean it’s a worthy trade off. People write software in python despite it being slower than C++.
- hutrdvnj 5y agoExcept that anything that is actually performance critical is written as a C extension python module. I think that low level filesystem operations are very performance critical.
- jeffbee 5y agoI doubt that mounting a filesystem is performance-critical. You could afford to fork an unprivileged user-space process written in Perl to parse these mount options and that would be fast enough for everyone.
- YarickR2 5y agoTell that to dockerd mounting images layer by layer , with k8s doing all kinds of emptyDir/PVC mounts on top. Pod start up speeds are abysmal now, they would be positively glacial with userspafe permissions validations
- jeffbee 5y agoThat's exactly my point. People who are doing lots of mounts are already demonstrably not performance-sensitive to a difference of a few milliseconds. They already waited 20 minutes for the stupid cluster autoscaler to provision a machine for them. They DGAF.
- Shorel 5y agoThey just need some time off for leisure activities. https://xkcd.com/303/ https://xkcd.com/303/
- stormbrew 5y ago?? The layering unionfs (really aufs or overlayfs) mounts docker does are all in kernel. There's no userspace involvement in the actual file ops. I'm not at all sure what you think any of that has to do with the idea of usermode filesystem handling. Anyways, on linux userland filesystem stuff (ie. fuse) is slow because the kernel manages the vfs layer and has to mediate. In a system designed for non-privileged vfs it doesn't have to be anywhere near so involved. And beyond that, there's really nothing in particular that a filesystem driver does that needs to be privileged to 'run fast'. VFS is pretty much the posterchild case for how you can pull things out of a kernel and maintain performance, tbh. There's no reason at all it can't be fast except the kernel getting in the way rather than helping.
- jeffbee 5y agoAs more and more things move out of the kernel, the perceived performance problems of microkernels look less important. If you are doing your network protocols in user space, and your thread scheduling is in user space, and you're not using a traditional filesystem much, then suddenly nobody cares how fast the kernel is.
- stormbrew 5y agoYeah this, really. For the most part even monolithic kernels have kind of reversed trend in the last decade or so and there's a lot of push to move critical code out of the kernel. A lot of new kernel apis are built to avoid context switching, and part of that usually involves moving to a more asynchronous kind of communication between process and kernel. Often these APIs even look an awful lot like late generation microkernel shared memory buffer protocols. DRI and uring in linux for example. A lot of the "microkernels are inherently slow" meme is built on how earlier port-based message passing kernels like mach worked.
- athrowaway3z 5y agoI'm really not understanding what you're saying here. What the hell is a microkernel here? What kind of security are you talking about? User space filesystem and network implementations still need access to the hardware. Multiplexing that access is a kernels job. The more you want to separate and hide that between clients the higher the cost. As far as i understand your argument you are saying "If an application has a dedicated hard drive there will be little overhead"
- deleted 5y ago[deleted]
- jeffbee 5y agoPeople think a monolithic kernel can be faster because of high-level abstractions that make many calls within the kernel, for example if I write to a TCP socket and everything else is handled for me, in the kernel, by function calls only. People believe this is faster than having an isolated network stack that has to pass messages to an isolated network driver and all that. But increasingly people realize that the performance of writing to a TCP socket in a unikernel also pretty much sucks and you get a much better result as you move more and more of it into user space. For example you decide, correctly, that TCP is obsolete and you switch to QUIC. Now the existence of the Linux TCP stack is of no value to you. You furthermore discover that Linux firewall, traffic control, and routing also kinda sucks, so you start using raw networking. Then you discover that trying to get your frames processed on the right core at the right moment isn't great in Linux, so you just take over the whole net device with DPDK. Now, nothing in the whole Linux network stack is of any use to you at all. The same thing can happen with storage. Maybe you started with files on XFS but then eventually you were using disaggregated storage where a service takes over the whole device with SPDK, and all the storage users are talking to the service instead of the kernel.
- nwmcsween 5y agoThis depends on the definition of the word microkernel, in the classical definition yes it will be much slower due to IPC, for something like an exokernel though it will be much faster than even a monolithic kernel.
- snvzz 5y agoThere's more myth than truth[0]. In the early days, they were slow. Mach, used in OSX, is a representative of those early days. Liedtke's L4 proved that a performant microkernel is possible. Later, SMP changed the scenario considerably, as all of a sudden the microkernel multiserver fits SMP like a globe, while monolithic kernels need the complexity of locks to handle it. [0] https://news.ycombinator.com/item?id=10824382 https://news.ycombinator.com/item?id=10824382
- erichocean 5y ago> Mach, used in OSX, is a representative of those early days. Mach, the microkernel, is not using in OS X and never has been. Mach, the API, is used (mostly due to legacy reasons). OS X has a Linux-style monolithic kernel (with legacy Mach APIs in userspace).
- dralley 5y agoI thought Windows and OSX were closer to hybrid kernels, at least with respect to running a lot of their drivers in userspace.
- dippersauce 5y agoAlmost every developer I have worked with considers NT and XNU to be hybrid at this point. Unfortunately, almost everything in the parent comment is incorrect.
- erichocean 5y ago> Unfortunately, almost everything in the parent comment is incorrect. Avie Tevanian would disagree, but what does he know? P.s. Nice job regurgitating Wikipedia in your other comment, without understanding it. I guess with only 30 karma, you've got to get your HN points somehow… Next time, read the Wikipedia entry on Mach so you'll learn that Mach didn't even become an actual microkernel until version 3.0. OS X's XNU kernel branched at 2.5. Oops.
- 5y ago
- roblabla 5y agoThe Nintendo Switch operating system, Horizon/NX, is a capability-based microkernel architecture. It's nowhere near unusably slow. In fact, its performance are pretty good. It does "cheat" a bit in that the whole OS runs on a single core, dedicating the remaining three cores to the game. But that may actually be the most efficient use of the hardware.
- 01100011 5y agoGenerally yes. The microkernel architecture is theoretically better in many ways and this has led to many attempts over the years to switch to that architecture. Some attempts have been relatively successful. Over time, as hardware becomes more heterogeneous and more capable, we are likely going to see a move to microkernels. Like many engineering decisions, the choice is not always clear cut. Other commenters have suggested microkernels are clearly superior and not choosing them is stupid, but there are many facets to that decision.
- pjmlp 5y agoQNX is a microkernel and is used everywhere on embedded space, and it isn't the only one. Microkernels are the preferred choice in high integrity computing.
- deleted 5y ago[deleted]
- a-dub 5y agoi predict that tanenbaum will ultimately win the famous monolithic vs. microkernel design debate. monolithic kernels are good for building features quickly and runtime performance, but the security design reminds me of 90s era computer security approaches, where firewalls were supposed to stop all threats and behind them security was lax on internal networks. microkernels are much more similar to today's more effective defense in depth approaches. what does it matter if your kernel is fast and featureful if you cannot trust it?
- snvzz 5y ago>what does it matter if your kernel is fast and featureful if you cannot trust it? And if the kernel is Linux, I'm not so sure about fast. Relative to Linux, seL4 has: - Order of magnitude faster context switch. - Order of magnitude lower scheduler latency. - Order of magnitude faster Inter-Process Communication.
- dundarious 5y agoYou can't really draw conclusions about systems built on Linux vs seL4 from that though. You can have far more IPC in order to do anything useful in microkernels. I'm not dismissing either OS or architecture, but just saying that extrapolating from micro-metrics is very hard when their use in the different architectures varies significantly.
- VWWHFSfQ 5y ago> i predict that tanenbaum will ultimately win the famous monolithic vs. microkernel design debate. Tanenbaum already lost the debate a long time ago. Minix is running in Intel CPUs but it's hardly exercising the benefits of a micro-kernel architecture. General-purpose PCs are running mono-kernels. Maybe the micro-kernel will prove useful at some point in the future, but that's just theoretical. But _this_ war was lost. Maybe they'll win the next one!
- a-dub 5y agoi predict that ultimately the linux kernel will prove too difficult to fully secure. i predict that the successor will ultimately be a microkernel architecture with ipc that is built from the ground up to be hardened against hostile components and will be accelerated in hardware. i predict we'll see something like realtime cryptographic proofs of both the identity and correct execution of operating system component code and the code of user programs.
- ylyn 5y agoYou likely run only a small subset of those millions of lines, because the bulk of those are in drivers and arch-specific code..
- inshadows 5y agodon't forget rust