3 ms·
What is it that you actually need? Latency? Jitter? The "good" news is that most bare metal hosts like Equinix and SoftLayer haven't caught up to Nitro so they
by wmf 5y ago
What is it that you actually need? Latency? Jitter?
The "good" news is that most bare metal hosts like Equinix and SoftLayer haven't caught up to Nitro so they use traditional NICs.
And if you can use the OFED API, have you tried the Elastic Fabric Adapter?
- scrubs 5y agoMostly looking for low latency. >The "good" news is that most bare metal hosts ... Thank you. Will checkout references. The system I'm working on, for the I/O part, will be a rewrite of: https://www.usenix.org/system/files/nsdi19-kalia.pdf https://www.usenix.org/system/files/nsdi19-kalia.pdf The idea there is that not so many UDP packets are lost so, with a little help in congestion and packet loss, you can get UDP speed reliably. DPDK, even on a virtualized NIC like AWS, can enqueue UDP packets in ~500ns if the NIC's TXQ isn't full. So compared to, for example, https://blog.cloudflare.com/how-to-receive-a-million-packets/ https://blog.cloudflare.com/how-to-receive-a-million-packets... you can get a lot more done in a lot less resources than kernel based work. But as I say AWS are virtualized NICs. Which is why I was asking for options for bare metal with regular-old-NICs on the PCI bus. So although developing on AWS spot instances is pretty seamless it seems like it defeats the point of using DPDK which I guess would shine even brighter if the virtualized layer was not in the way. And, no, I have not tried EFA although I've definitely seen it on AWS. Thank you for time and response.
- wmf 5y agoIf you get this working it would be interesting to compare the latency of AWS vs. something else. It might not be as different as you expect.