25 ms·
The solution on the receive side is LRO. I was doing 10GbE line rate with 1500b frames in 2006 or so on consumer-grade CPUs using software LRO (implemented in
by drewg123 5y ago
The solution on the receive side is LRO.
I was doing 10GbE line rate with 1500b frames in 2006 or so on consumer-grade CPUs using software LRO (implemented in the driver).
I worked for a NIC vendor (Myricom) that shipped our NIC drivers with a default 9000b MTU. That was fine when we just did HPC & everything reachable via layer 2 was another one of our NICs with a 9k MTU. But it was a mess when we started selling 10GbE NICs. I got pretty good at diagnosing MTU mis-matches..
- jeffbee 5y agoI don't doubt that you can hit 10g on a wimpy core, the question is how much is left over for your application to use. I recently analyzed jumbo vs. puny frames in EC2 with the ENA and the difference in softirq time amounted to one core out of the 32 cores on the instance type, at 12.5gbps line rate. That's pretty substantial cost when you have a lot of nodes. The ENA doesn't have a ton of offload features and EC2 tenants don't get to specify a better NIC.
- drewg123 5y agoIs this linux GRO, or LRO? I've found that GRO is can be less efficient than LRO, but its been 7 years since I paid much attention to Linux performance..