3 ms·
> My understanding always was that they're some special kind of hosting provider. But I never really got it. The main selling point is/was being closer to the
by throw0101a 7y ago
> My understanding always was that they're some special kind of hosting provider. But I never really got it.
The main selling point is/was being closer to the hardware and thus getting better utilization. Virtualizing at the machine level was a lot slower (especially before Intel VT-x and AMD-V came along) and so one wouldn't lose (say) 30% right off the top:
* https://en.wikipedia.org/wiki/OS-level_virtualisation https://en.wikipedia.org/wiki/OS-level_virtualisation
- jaytaylor 7y agoIn this case, do clouds with physical bare-metal provisioning capabilities like EC2 / GCP / Azure / OCI kill the Joyent value proposition?
- jen20 7y agoNot really - since the bare metal provisioning tends only to be large, expensive instance types. The benefit of secure OS-level virtualisation is that you can co-locate the smaller workloads of multiple tenants on the same bare metal, while not incurring the overhead of hardware virtualisation. When you compared the utility of JCP "tiny" instance (1 CPU worth of shares, 256MB of RAM) to a t2.micro or similar instance in AWS, the difference was astounding. Part of this is the CPU credit mechanism on T2 instances, but I'd wager that a good part of it was being in OS-level virtualisation.
- cookiecaper 7y agoDocker killed the value proposition. "Worse is better". FreeBSD's jails and illumos's zones have always been far, far superior technically, providing actual kernel encapsulation and coherent administration utilities, but Docker had the triple combination of the familiarity of Linux, the cute whale, and the bonfire of VC dollars to drive adoption. There is still a great deal of administrative/technical value in using anything-but-Docker if you can tolerate the social stigma, but who can? The CxOs need that Docker/Kubernetes feather in their cap so they can look cool at conferences. Suggesting SmartOS/illumos gets you sideways looks at the very bare minimum. When I stated that I was thinking about using it here over a year ago, my inbox was immediately flooded with accusations that I was part of a Joyent-bankrolled cabal, because clearly no sane ordinary person would consider such a dead platform. In the interim, OmniTI has gone belly-up and OpenZFS has deemed ZFS on Linux the rightful heir to the ZFS throne, and now the Joyent Public Cloud is shuttering. If the impression that you had to be part of a conspiracy to use SmartOS for a greenfield project was reasonable then, it's only more reasonable now. The sun may yet rise again on illumos some day, but it's time to accept that it's well into the night now.
- RantyDave 7y agoJoyent's value proposition was killed (for the most part) by the experience of using their public interface. It would've taken a great deal of bravery to try that and decide a local install would be better. The node thing also did a lot of damage - Joyent wrote a lot of the SmartOS/Triton command line tools in node so they were slow as hell. Triton itself is a very non-trivial install although quite probably less so than a complete k8s rig. There are also some really subtle Linux compatibility problems. For instance: IIRC a SmartOS malloc will not fail. Ever. But it might not return either. There's a really complicated mark/sweep type virtual memory thing and the documentation is good, for the nasty node stuff, and kinda terrible otherwise. Finally, and with no lack of irony, you just can't run SmartOS on the cloud. For a start it needs to do its first boot off a CD and subsequent boots off a USB drive-type-arrangement. The hard part is that most cloud providers run a butchered Linux kernel and not a fully generalised VM - and on vultr at least, while they run a proper VM, for some reason the processors don't "come up". I've not looked at all this stuff for at least a year so it may have changed. Either which way I believe the majority of the community is now on OmniOS - which I always got on better with anyway.
- jen20 7y ago> Triton itself is a very non-trivial install Actually I'd say the Triton install is not only trivial, but should be a model for other similar systems. During my testing with Intel NUCs, I had a usable system deploying containers in under 20 minutes. Most managed Kubernetes systems cannot even provision in that time frame. > you just can't run SmartOS on the cloud. The installer may lead you to the USB and install path, but it is not necessary. I built Vagrant boxes that had SmartOS on a regular disk, and I believe that more recently SmartOS has been running well in GCP. There is no reason it could not run in AWS or Azure, either.
- merb 7y ago> Most managed Kubernetes systems cannot even provision in that time frame. when was the last time you used k8s?! I mean as of now there is even the expirmental k3os which boots a fully fledged k8s in seconds. you can even built a cluster with it. sadly HA backplane is still not available since k3s is still early in its development.
- hinkley 7y agoYou will also hear a lot of bragging about how much more robust the partitioning is on Solaris versus Linux. Which is why they did the work to get Linux containers running on top of Solaris instead of just doing Linux.
- throw0101a 7y agoI haven't been paying attention recently, but last time I checked, there were no known escapes out of Solaris zones, while there are quite a few CVEs about escaping Linux containers and even QEMU/KVM/Xen. The one escape out of FreeBSD jails that I'm aware of (CVE-2005-2218) involved not a bug in the jails code, but by burrowing out via devfs. So it seems that OS-level virtualization/security has a better track record.
- cookiecaper 7y agoYes, for a very long time the Linux devs were emphatic that cgroups should be not be treated as an actual isolation/security barrier. This was flagrantly ignored and like most things in the Linux ecosystem, the functionality was eventually kinda-sorta backfilled based on the community's refusal to accept anything else. Meanwhile, FreeBSD and Solaris had quietly provided coherent tools to accomplish the same ends securely for many years. The story of the BSDs and illumos is really a tragedy about the complete and total disconnect between technical quality+value and technology adoption. People utilize technology products as fashion statements first and foremost, and the Linux fashion was easily the most desirable -- indeed, aside from PC v. Mac, it's the only one generally known by average technophiles. As a technical entrepreneur, I've discovered the sad reality that it's really only the most superficial 10% of any functionality that drives virtually all adoption. Everything else is marketing, even in supposedly heavily-technical endeavors like running an open-source kernel. The more you invest in engineering beyond that initial superficial component, the less you have to invest in brand promotion. One can choose to gratify their own sense of righteousness and ignore this, and that is certainly a valid option to take, but then they shouldn't be surprised to see their lunch eaten by someone who took the other side of the bargain.
- 7y ago