5 ms·

Advantages to running FreeBSD as a server operating system

66 points by signa11 3y ago

behnamoh 3y ago
I want articles to get to the point quickly. I don’t want them to start with “What is FreeBSD?” I know people do it for Google SEO, but it’s messed up, please stop it.
- vermaden 3y ago
  There You go: - https://vermaden.wordpress.com/2020/09/07/quare-freebsd/ https://vermaden.wordpress.com/2020/09/07/quare-freebsd/
betaby 3y ago
tl;dr: 1. ZFS 2. pkg 3. unclear ... profit?
- deleted 3y ago
  [deleted]
nimbius 3y ago
this mostly seems like cheerleading for ZFS? how about ASLR support, the amazing pf tables firewall, dtrace awesomeness, cool things to do with jails, or bhyve virtualization? granted ZFS is a big flex on the BSD official site as well since its effectively the only way the OS can do things like raid10 with dedup. instead of porting XFS or BTRFS the BSD devs chose to keep developing a fork of Oracle/Sun's commercial product.
- znpy 3y ago
  Zfs is the same cosebase that runs on linux (freebsd people literally dropped their implementation and imported openzfs into their source tree). It’s not merged in linux purely for license incompatibility (cddl vs gpl, iirc?) For the other stuff (aslr, pf, dtrace etc) linux has either equivalent or better alternatives (eg: perf/ebpf, iptables/nftables, kvm) etc. Regarding btrfs… most linux distro ship it and some (eg: fedora) use that as default fs. Zfs is more intuitive and more ergonomic in my opinion, but i might switch to btrfs anyway if anything so I don’t have to worry about updating the kernel. > instead of porting XFS or BTRFS the BSD devs chose to keep developing a fork of Oracle/Sun's commercial product. Again, not true and actually the exact opposite: since openzfs is cddl-licensed, oracle cannot use that in solaris.
  - vermaden 3y ago
    Both BTRFS and XFS write support is supported by 'sysutils/fusefs-lkl' on FreeBSD. No need to port anything. ZFS is superior to BTRFS - first of all its safe and secure - I do not know how many more years wil ltake BTRFS to finally properly fix their RAID5/RAID6 implementations to not loose data .... and that also gives warning for general usage in any other way. In which way iptables/nftables is better when IPFW or PF? The only feature that KVM has against BHYVE is live migration ...
- yjftsjthsd-h 3y ago
  > instead of porting XFS or BTRFS the BSD devs chose to keep developing a fork of Oracle/Sun's commercial product. XFS doesn't even try to solve the same problems, and BTRFS is GPLv2 and only just starting to lose its reputation for not eating data, and that only if you avoid some RAID mode. So yes, ZFS is far away better
- the-dude 3y ago
  AFAIK XFS has been part of FreeBSD for a long time. I remember around 2008 at least. https://man.freebsd.org/cgi/man.cgi?query=xfs&sektion=5&apropos=0&manpath=FreeBSD+7.0-RELEASE https://man.freebsd.org/cgi/man.cgi?query=xfs&sektion=5&apro...
ar-nelson 3y ago
I really wanted to like FreeBSD. ZFS is cool, jails are cool, pkg has such a wide variety of packages that it's comparable to Arch. In a world before Docker and btrfs, this would be enough to make installing FreeBSD worthwhile. I tried it anyway, for a home server, and it was mostly painful. Jails are tricky and require third-party (?) tools and scripts to manage them effectively. And they don't give you much that Docker doesn't already. And, although it's not as bad as Arch, FreeBSD does update quickly and if you aren't frequently updating your server you can be left behind; it's not noticeable until you try to update and a bunch of packages break, or your jails are no longer running the same major version as their host and that causes subtle bugs. I recently replaced my FreeBSD home server with a basic Debian machine running a docker-compose cluster, and it's so much simpler. I wanted to like FreeBSD. At its core, it's probably a better-designed system. But it requires too much additional knowledge and maintenance for something that Linux and Docker do just as well.
- znpy 3y ago
  > In a world before Docker and btrfs, this would be enough to make installing FreeBSD worthwhile FreeBSD is really missing out in not implementing something to run containers, and it shouldn’t even be impossible. The podman people basically reimplemented the docker daemon command line (and apis), and I remember a talk by Bryan Cantrill about how joyent reimplemented the docker API to spawn Illumos/SmartOS zones backed by zfs volumes (i guess either datasets or zvols). And there was some person reimplementing the docker apis using jails as a backend… but I guess that project never went anywhere and didn’t get the attention (and funding/developer time?) of the freebsd foundation.
- kjs3 3y ago
  Jails are tricky and require third-party (?) tools and scripts to manage them effectively. Docker is a third party tool. People use third-party tools and scripts to manage them effectively. Having done jails for years and now having to get comfortable with Docker for $DAYJOB, there's not a huge difference in complexity, just different complexity, as long as you actually learn the tools.
- thijsvandien 3y ago
  For me it's the opposite really. Every time I touch Linux, I'm overwhelmed by how messy it is. I spent hours upgrading an old Ubuntu box serving as a Ubiquity UniFi Controller and ended up in some kind of dependency hell. While trying to fix all that, disk space ran out. Then I had enough, whiped the whole thing and in 5 minutes installed the FreeBSD base system. A handful of binary packages and a couple of edits to config files later everything worked perfectly. It all feels so clean, with a minimal number of processes running.
jedberg 3y ago
My favorite part of running a FreeBSD cluster was that you almost never had to reboot it. The kernel rarely changed -- most kernel settings could be changed on the fly with a config file, and most everything else ran in userspace. We had boxes with uptimes over 700 days. Nowadays that matters a lot less, since you most likely have redundant hardware. But back then (in the 90s), hardware was expensive and more often than not you had one big beefy box running your entire website, so reboots mattered. I miss running FreeBSD. But for a long time you couldn't run it in EC2, and I never ran it as a home server, because at home I'm more interested in experimental things that usually show up on Linux first. But it was great what I was running enterprise on-prem hardware.
- ksec 3y ago
  May be it's time to reboot Yahoo 2.0 along with its server infrastructure which were all running on FreeBSD.
- znpy 3y ago
  For that matter, you could almost never reboot linux. Linus supports kernel live patching, so you can get the latest bugfixes for the current kernel version without a reboot. Anything else, including systemd, is upgradeable and restartable like a normal userspace component.
pdntspa 3y ago
So FreeBSD supposedly has full Linux kernel emulation or something to that effect. To the point where you can run Debian in a jail without virtualization? I am wondering if it is possible to rig up Docker to work in that? Because I really adore jails but I agree that the tooling around them makes a mess of config and such. (I have been using ezjail which I'm told is now deprecated) With so much of my world buying into the Docker cargo cult it would be nice if I could play along and I'm wondering if Linux-in-a-jail is a possible answer.
- znpy 3y ago
  > I am wondering if it is possible to rig up Docker to work in that? Unlikely, 99.9% the answer is no (at least not currently). FreeBSD does not have “full kernel emulation”. What it has is a table mapping linux syscalls to freebsd equivalent, essentially an adaptor. This, along with a typical linux runtime (glibc and other libraries) means that you can execute linux binaries. But this goes as far as the translation table goes. To run docker containers you’d need an equivalent syscall to create (pid, network, uts etc) namespaces and (cpu,memory) cgroups. There is no equivalent of those syscalls in FreeBSD at the time of writing, as far as I know.
- mikehotel 3y ago
  You may want to check out iocage for managing jails. It has not had a release in a few years but it is maintained. https://www.freshports.org/sysutils/iocage/ https://www.freshports.org/sysutils/iocage/
  - mvanbaak 3y ago
    Where is it maintained? The port is, but the upstream?
  - pdntspa 3y ago
    I have been looking to migrate to something else but my fear with iocage is that I'm going to be in the same situation a few years from now. What's the current hotness? Bastille?
discardedrefuse 3y ago
FreeBSD is great, if your hardware is supported. And unfortunately, that's a giant IF. I wanted to try jails on a 2011 HP DL380 G7, which is enterprise level hardware. I had to jump through several hoops to even get off the ground. Apparently FreeBSD didn't come with power management out of the box. So I had to learn about powerd, Intel Speedstep, and CPU C-states (but hey, it comes with a mail server pre-installed). And even then I was having issues. So I gave up and installed Alpine Linux, which worked perfectly with no extra config. I learned LXD instead. Since then, I've replaced that behemoth of a server with a couple low power, tiny desktops running Debian (bookworm has LXD in the default repos now). I didn't actually look, but I'm fairly certain FreeBSD wasn't going to play nice with Intel's QuickSync and GPU passthrough to jails like Debian/LXD does. Anyways, that's always been my biggest hurdle with FreeBSD. I do like the cohesiveness of all their tooling though.
- znpy 3y ago
  If you’re running lxc containers on debian you might as well switch to proxmox (it’s debian underneath), cluster those machines together and have a nice web ui, http apis and a cli. If only it had an official terraform provider, it’d be perfect.
  - discardedrefuse 3y ago
    Thanks for your suggestion. It's a good one that I might consider in the future. I ran normal VMs in Proxmox for years, so I'm quite familiar with it. But I feel like having two separate systems gives me a more flexible playground for my homelab.
reliefcrew 3y ago
The FreeBSD Handbook
IWeldMelons 3y ago
I used FreeBSD till early 2000's, when Linux had become a better choice. I've installed Chromium on FreeBSD 12 and it was impossible to enable to antialised fonts, no matter what I had tried. Generally, it is worse as a desktop system than more even obscure OpenBSD.
- red-iron-pine 3y ago
  > Generally, it is worse as a desktop system than more even obscure OpenBSD. there is a very polished, BSD-based desktop available, albeit at a fairly high price compared to FOSS alternatives
  - znpy 3y ago
    MacOS?
- von_lohengramm 3y ago
  > Generally, it is worse as a desktop system than more even obscure OpenBSD. This is just untrue.
- doublerabbit 3y ago
  > Generally, it is worse as a desktop system than more even obscure OpenBSD. Only because you couldn't get AA with chromium? FreeBSD is my daily driver, stable as a brick. Everything just works. Never going back.
  - rahen 3y ago
    I run NetBSD as a desktop and AA also works with Chromium. This looks strange.
dilippkumar 3y ago
I evaluated using FreeBSD for a project. The biggest challenge for me was I couldn't figure a way to fit modern DevOps into FreeBsd. OCI compliant containers are not supported. The best way I could come up with for a minimum blue-green deployment strategy was writing a ton of scripts myself. I can not imagine running a fleet of FreeBSD servers where a team of developers deploy 10+ times a week to a swarm of containers running micro services. What solutions do other practitioners use with FreeBSD? Or do you abandon modern DevOps practices entirely and hold a meeting to determine partition sizes, provision servers to individual services running on specific named computers and plan for a software upgrade for weeks in advance of a deployment?
- ktaylora 3y ago
  If you are working with FreeBSD in the cloud, you can use Terraform to provision on AWS and GCP. If you have to manage bare metal FreeBSD systems at scale (hundreds of systems), most devops folks use Ansible. There are playbooks out there for this. It's not too painful to work with. If you are looking for Kubernetes on FreeBSD, don't. For on-prem Kubernetes you could deploy on Linux virtual machines on FreeBSD servers, managed using Ansible. But it's never going to be as fast as Linux. I wouldn't use it in production. The best answer is to leverage FreeBSD for what it's good at : bare metal services like databases, build environments, file servers, and networking devices. And co-manage your deployment with Linux (Kubernetes) using Ansible/Terraform.
deleted 3y ago
[deleted]

66 points by signa11 3y ago

I want articles to get to the point quickly. I don’t want them to start with “What is FreeBSD?” I know people do it for Google SEO, but it’s messed up, please stop it.

vermaden 3y ago
There You go: - https://vermaden.wordpress.com/2020/09/07/quare-freebsd/ https://vermaden.wordpress.com/2020/09/07/quare-freebsd/

betaby 3y ago

tl;dr: 1. ZFS 2. pkg 3. unclear ... profit?

deleted 3y ago
[deleted]

nimbius 3y ago

this mostly seems like cheerleading for ZFS? how about ASLR support, the amazing pf tables firewall, dtrace awesomeness, cool things to do with jails, or bhyve virtualization? granted ZFS is a big flex on the BSD official site as well since its effectively the only way the OS can do things like raid10 with dedup. instead of porting XFS or BTRFS the BSD devs chose to keep developing a fork of Oracle/Sun's commercial product.

znpy 3y ago
Zfs is the same cosebase that runs on linux (freebsd people literally dropped their implementation and imported openzfs into their source tree). It’s not merged in linux purely for license incompatibility (cddl vs gpl, iirc?) For the other stuff (aslr, pf, dtrace etc) linux has either equivalent or better alternatives (eg: perf/ebpf, iptables/nftables, kvm) etc. Regarding btrfs… most linux distro ship it and some (eg: fedora) use that as default fs. Zfs is more intuitive and more ergonomic in my opinion, but i might switch to btrfs anyway if anything so I don’t have to worry about updating the kernel. > instead of porting XFS or BTRFS the BSD devs chose to keep developing a fork of Oracle/Sun's commercial product. Again, not true and actually the exact opposite: since openzfs is cddl-licensed, oracle cannot use that in solaris.
- vermaden 3y ago
  Both BTRFS and XFS write support is supported by 'sysutils/fusefs-lkl' on FreeBSD. No need to port anything. ZFS is superior to BTRFS - first of all its safe and secure - I do not know how many more years wil ltake BTRFS to finally properly fix their RAID5/RAID6 implementations to not loose data .... and that also gives warning for general usage in any other way. In which way iptables/nftables is better when IPFW or PF? The only feature that KVM has against BHYVE is live migration ...
yjftsjthsd-h 3y ago
> instead of porting XFS or BTRFS the BSD devs chose to keep developing a fork of Oracle/Sun's commercial product. XFS doesn't even try to solve the same problems, and BTRFS is GPLv2 and only just starting to lose its reputation for not eating data, and that only if you avoid some RAID mode. So yes, ZFS is far away better
the-dude 3y ago
AFAIK XFS has been part of FreeBSD for a long time. I remember around 2008 at least. https://man.freebsd.org/cgi/man.cgi?query=xfs&sektion=5&apropos=0&manpath=FreeBSD+7.0-RELEASE https://man.freebsd.org/cgi/man.cgi?query=xfs&sektion=5&apro...

ar-nelson 3y ago

I really wanted to like FreeBSD. ZFS is cool, jails are cool, pkg has such a wide variety of packages that it's comparable to Arch. In a world before Docker and btrfs, this would be enough to make installing FreeBSD worthwhile. I tried it anyway, for a home server, and it was mostly painful. Jails are tricky and require third-party (?) tools and scripts to manage them effectively. And they don't give you much that Docker doesn't already. And, although it's not as bad as Arch, FreeBSD does update quickly and if you aren't frequently updating your server you can be left behind; it's not noticeable until you try to update and a bunch of packages break, or your jails are no longer running the same major version as their host and that causes subtle bugs. I recently replaced my FreeBSD home server with a basic Debian machine running a docker-compose cluster, and it's so much simpler. I wanted to like FreeBSD. At its core, it's probably a better-designed system. But it requires too much additional knowledge and maintenance for something that Linux and Docker do just as well.

znpy 3y ago
> In a world before Docker and btrfs, this would be enough to make installing FreeBSD worthwhile FreeBSD is really missing out in not implementing something to run containers, and it shouldn’t even be impossible. The podman people basically reimplemented the docker daemon command line (and apis), and I remember a talk by Bryan Cantrill about how joyent reimplemented the docker API to spawn Illumos/SmartOS zones backed by zfs volumes (i guess either datasets or zvols). And there was some person reimplementing the docker apis using jails as a backend… but I guess that project never went anywhere and didn’t get the attention (and funding/developer time?) of the freebsd foundation.
kjs3 3y ago
Jails are tricky and require third-party (?) tools and scripts to manage them effectively. Docker is a third party tool. People use third-party tools and scripts to manage them effectively. Having done jails for years and now having to get comfortable with Docker for $DAYJOB, there's not a huge difference in complexity, just different complexity, as long as you actually learn the tools.
thijsvandien 3y ago
For me it's the opposite really. Every time I touch Linux, I'm overwhelmed by how messy it is. I spent hours upgrading an old Ubuntu box serving as a Ubiquity UniFi Controller and ended up in some kind of dependency hell. While trying to fix all that, disk space ran out. Then I had enough, whiped the whole thing and in 5 minutes installed the FreeBSD base system. A handful of binary packages and a couple of edits to config files later everything worked perfectly. It all feels so clean, with a minimal number of processes running.

jedberg 3y ago

My favorite part of running a FreeBSD cluster was that you almost never had to reboot it. The kernel rarely changed -- most kernel settings could be changed on the fly with a config file, and most everything else ran in userspace. We had boxes with uptimes over 700 days. Nowadays that matters a lot less, since you most likely have redundant hardware. But back then (in the 90s), hardware was expensive and more often than not you had one big beefy box running your entire website, so reboots mattered. I miss running FreeBSD. But for a long time you couldn't run it in EC2, and I never ran it as a home server, because at home I'm more interested in experimental things that usually show up on Linux first. But it was great what I was running enterprise on-prem hardware.

ksec 3y ago
May be it's time to reboot Yahoo 2.0 along with its server infrastructure which were all running on FreeBSD.
znpy 3y ago
For that matter, you could almost never reboot linux. Linus supports kernel live patching, so you can get the latest bugfixes for the current kernel version without a reboot. Anything else, including systemd, is upgradeable and restartable like a normal userspace component.

pdntspa 3y ago

So FreeBSD supposedly has full Linux kernel emulation or something to that effect. To the point where you can run Debian in a jail without virtualization? I am wondering if it is possible to rig up Docker to work in that? Because I really adore jails but I agree that the tooling around them makes a mess of config and such. (I have been using ezjail which I'm told is now deprecated) With so much of my world buying into the Docker cargo cult it would be nice if I could play along and I'm wondering if Linux-in-a-jail is a possible answer.

znpy 3y ago
> I am wondering if it is possible to rig up Docker to work in that? Unlikely, 99.9% the answer is no (at least not currently). FreeBSD does not have “full kernel emulation”. What it has is a table mapping linux syscalls to freebsd equivalent, essentially an adaptor. This, along with a typical linux runtime (glibc and other libraries) means that you can execute linux binaries. But this goes as far as the translation table goes. To run docker containers you’d need an equivalent syscall to create (pid, network, uts etc) namespaces and (cpu,memory) cgroups. There is no equivalent of those syscalls in FreeBSD at the time of writing, as far as I know.
mikehotel 3y ago
You may want to check out iocage for managing jails. It has not had a release in a few years but it is maintained. https://www.freshports.org/sysutils/iocage/ https://www.freshports.org/sysutils/iocage/
- mvanbaak 3y ago
  Where is it maintained? The port is, but the upstream?
- pdntspa 3y ago
  I have been looking to migrate to something else but my fear with iocage is that I'm going to be in the same situation a few years from now. What's the current hotness? Bastille?

discardedrefuse 3y ago

FreeBSD is great, if your hardware is supported. And unfortunately, that's a giant IF. I wanted to try jails on a 2011 HP DL380 G7, which is enterprise level hardware. I had to jump through several hoops to even get off the ground. Apparently FreeBSD didn't come with power management out of the box. So I had to learn about powerd, Intel Speedstep, and CPU C-states (but hey, it comes with a mail server pre-installed). And even then I was having issues. So I gave up and installed Alpine Linux, which worked perfectly with no extra config. I learned LXD instead. Since then, I've replaced that behemoth of a server with a couple low power, tiny desktops running Debian (bookworm has LXD in the default repos now). I didn't actually look, but I'm fairly certain FreeBSD wasn't going to play nice with Intel's QuickSync and GPU passthrough to jails like Debian/LXD does. Anyways, that's always been my biggest hurdle with FreeBSD. I do like the cohesiveness of all their tooling though.

znpy 3y ago
If you’re running lxc containers on debian you might as well switch to proxmox (it’s debian underneath), cluster those machines together and have a nice web ui, http apis and a cli. If only it had an official terraform provider, it’d be perfect.
- discardedrefuse 3y ago
  Thanks for your suggestion. It's a good one that I might consider in the future. I ran normal VMs in Proxmox for years, so I'm quite familiar with it. But I feel like having two separate systems gives me a more flexible playground for my homelab.

reliefcrew 3y ago

The FreeBSD Handbook

IWeldMelons 3y ago

I used FreeBSD till early 2000's, when Linux had become a better choice. I've installed Chromium on FreeBSD 12 and it was impossible to enable to antialised fonts, no matter what I had tried. Generally, it is worse as a desktop system than more even obscure OpenBSD.

red-iron-pine 3y ago
> Generally, it is worse as a desktop system than more even obscure OpenBSD. there is a very polished, BSD-based desktop available, albeit at a fairly high price compared to FOSS alternatives
- znpy 3y ago
  MacOS?
von_lohengramm 3y ago
> Generally, it is worse as a desktop system than more even obscure OpenBSD. This is just untrue.
doublerabbit 3y ago
> Generally, it is worse as a desktop system than more even obscure OpenBSD. Only because you couldn't get AA with chromium? FreeBSD is my daily driver, stable as a brick. Everything just works. Never going back.
- rahen 3y ago
  I run NetBSD as a desktop and AA also works with Chromium. This looks strange.

dilippkumar 3y ago

I evaluated using FreeBSD for a project. The biggest challenge for me was I couldn't figure a way to fit modern DevOps into FreeBsd. OCI compliant containers are not supported. The best way I could come up with for a minimum blue-green deployment strategy was writing a ton of scripts myself. I can not imagine running a fleet of FreeBSD servers where a team of developers deploy 10+ times a week to a swarm of containers running micro services. What solutions do other practitioners use with FreeBSD? Or do you abandon modern DevOps practices entirely and hold a meeting to determine partition sizes, provision servers to individual services running on specific named computers and plan for a software upgrade for weeks in advance of a deployment?

ktaylora 3y ago
If you are working with FreeBSD in the cloud, you can use Terraform to provision on AWS and GCP. If you have to manage bare metal FreeBSD systems at scale (hundreds of systems), most devops folks use Ansible. There are playbooks out there for this. It's not too painful to work with. If you are looking for Kubernetes on FreeBSD, don't. For on-prem Kubernetes you could deploy on Linux virtual machines on FreeBSD servers, managed using Ansible. But it's never going to be as fast as Linux. I wouldn't use it in production. The best answer is to leverage FreeBSD for what it's good at : bare metal services like databases, build environments, file servers, and networking devices. And co-manage your deployment with Linux (Kubernetes) using Ansible/Terraform.

deleted 3y ago

[deleted]