3 ms·
Checkout TCP_REUSPORT_LB_NUMA on FreeBSD. It will filter incoming TCP connections to listen sockets owned by threads bound to the same NUMA domain as the NIC t
by drewg123 5y ago
Checkout TCP_REUSPORT_LB_NUMA on FreeBSD.
It will filter incoming TCP connections to listen sockets owned by threads bound to the same NUMA domain as the NIC that received the packets. This is part of the Netflix FreeBSD NUMA work described here https://papers.freebsd.org/2019/eurobsdcon/gallatin-numa_optimizations_network_stack/ https://papers.freebsd.org/2019/eurobsdcon/gallatin-numa_opt...
The idea is that you can keep connections local to a NUMA domain. We (Netflix) have a local patch to nginx to support this (basically just setting the socket ioctl on the listen socket after the nginx worker is bound)
- phkamp 5y agoYeah, so there are a lot of things we could optimize for on different kernels, but we prefer to not do so, until we have a really good reason. As I said above, it is not obvious to me that we would gain much over what we already do, but I am keeping an eye on it.