3 ms·

Just want to point out it's not that far out there to terminate 100gbps without breaking the bank these days. 1x Mellanox ConnectX-5 Dual Port 100GbE NIC ~$400

Just want to point out it's not that far out there to terminate 100gbps without breaking the bank these days. 1x Mellanox ConnectX-5 Dual Port 100GbE NIC ~$400 (single port ~$200), Brocade ICX6610/6650 ~$150/$600, then a hardware router (pricey) or server with routing software. VyOS is fine up to maybe 40gbps depending on hardware (not line rate), anything more would need something like VPP+FRR/VPP+DPDK/DANOS/TNSR. More for homelab, but a road I would definitely go down if 100gbps service was available to me for $50/month.

seanp2k2 3y ago
10gbps is ~800k-15m packets/sec. https://www.netgate.com/blog/tnsr-home-lab https://www.netgate.com/blog/tnsr-home-lab has a blog post about using their product to do 40gbps for someone with a home 100gbps lab setup (that uses a $30k switch among other things). Not sure what your financial situation is like, but getting even 10gbps across NAT is going to be at least a few grand (Netgate's HW solution that claims to saturate 10gbps with any packet size is $4k + $1k/yr software subscription https://shop.netgate.com/products/1541-base-tnsr https://shop.netgate.com/products/1541-base-tnsr ) and not many places would even support transferring at that speed, so what's the point unless you've got many heavy users?
- ihattendorf 3y ago
  > so what's the point unless you've got many heavy users? There isn't really a point except some people like to push the boundary for fun. Agreed it's not anywhere close to necessary for normal home users. But we don't always do things just because they're necessary :) I mentioned VyOS won't handle line rate (it'll do ~5 Mpps on average hardware) but there are options like DANOS that will. 10 Gbps is do-able with < $1k in hardware, including the server. VPP+FRR or VPP+DPDK can handle 100 Mpps/100 Gbps across NAT. And with the new Linux Control Plane in VPP, it's possible VyOS will get support in the future (https://vyos.dev/T1797 https://vyos.dev/T1797). They're also considering using eXpress Data Path (XDP). Again, totally pointless but so are many other things we spend our time/money on.

seanp2k2 3y ago

10gbps is ~800k-15m packets/sec. https://www.netgate.com/blog/tnsr-home-lab https://www.netgate.com/blog/tnsr-home-lab has a blog post about using their product to do 40gbps for someone with a home 100gbps lab setup (that uses a $30k switch among other things). Not sure what your financial situation is like, but getting even 10gbps across NAT is going to be at least a few grand (Netgate's HW solution that claims to saturate 10gbps with any packet size is $4k + $1k/yr software subscription https://shop.netgate.com/products/1541-base-tnsr https://shop.netgate.com/products/1541-base-tnsr ) and not many places would even support transferring at that speed, so what's the point unless you've got many heavy users?

ihattendorf 3y ago
> so what's the point unless you've got many heavy users? There isn't really a point except some people like to push the boundary for fun. Agreed it's not anywhere close to necessary for normal home users. But we don't always do things just because they're necessary :) I mentioned VyOS won't handle line rate (it'll do ~5 Mpps on average hardware) but there are options like DANOS that will. 10 Gbps is do-able with < $1k in hardware, including the server. VPP+FRR or VPP+DPDK can handle 100 Mpps/100 Gbps across NAT. And with the new Linux Control Plane in VPP, it's possible VyOS will get support in the future (https://vyos.dev/T1797 https://vyos.dev/T1797). They're also considering using eXpress Data Path (XDP). Again, totally pointless but so are many other things we spend our time/money on.