3 ms·

I think the common knowledge that most servers can't saturate a 10Gb Ethernet link is no longer true. In my experience even saturating 25Gb links is rather eas

by bradfa 5y ago

I think the common knowledge that most servers can't saturate a 10Gb Ethernet link is no longer true. In my experience even saturating 25Gb links is rather easy to do when using 9000 byte MTU on mid-tier server hardware. 100Gb links do take some thought and work to saturate, but that's improving at a good rate lately so I expect it'll become more common rather soon. The main downside to 25Gb and 100Gb links still seems to be hardware pricing. At these speeds, PCIe network adapters and switches get rather expensive rather quick and will make you really evaluate if your situation really demands those speeds. 10Gb SFP+ and copper network adapters and switches are quite inexpensive now in 2022.

gjulianm 5y ago
> In my experience even saturating 25Gb links is rather easy to do when using 9000 byte MTU on mid-tier server hardware. But that's tweaking the setup already, it requires changes, testing and verification, and can cause problems in downstream equipment. And for a lot of applications, a 9K MTU will not be enough to saturate the link because they'll need NUMA awareness, or the NIC queues will need tweaking to avoid imbalances, or the application is not ready to send at that speed... I'm not saying it can't be done, of course it can. But it isn't "plug a bigger card and it'll go faster".