4 ms·
DPUs/SmartNICs are a partial industry response to AWS Nitro (based on Annapurna acquisition) which performs I/O (network/storage) virtualization. Nvidia DPU
by walterbell 5y ago
DPUs/SmartNICs are a partial industry response to AWS Nitro (based on Annapurna acquisition) which performs I/O (network/storage) virtualization.
Nvidia DPU is based on Mellanox acquisition
AMD DPU is based on Pensado acquisition
Intel has an in-house DPU
There was a 2018 talk on AWS Nitro, https://www.youtube.com/watch?v=e8DVmwj3OEs https://www.youtube.com/watch?v=e8DVmwj3OEs
Cadence summary: https://community.cadence.com/cadence_blogs_8/b/breakfast-bytes/posts/the-aws-nitro-project https://community.cadence.com/cadence_blogs_8/b/breakfast-by...
James Hamilton summary: https://perspectives.mvdirona.com/2019/02/aws-nitro-system/ https://perspectives.mvdirona.com/2019/02/aws-nitro-system/
The founder of Annapurna-Nitro is now at https://www.lightbitslabs.com/ https://www.lightbitslabs.com/, which has created the NVMEoF (NVME over Fabric, i.e. Ethernet or FiberChannel) standard. This is implemented via a software driver or hardware accelerator. Both DPUs and NVMEoF can be viewed as an attempt to standardize "composable data center" architectures pioneered by AWS Nitro.
> but this is HN... what other uses can we put through this / what advantages does this physical architecture give us?
A good place to start is the decade-old NetFPGA SmartNIC research project from University of Cambridge, now in the 5th generation of hardware, with earlier boards sometimes available on eBay. https://netfpga.org/ https://netfpga.org/
A line-rate, flexible, and open platform for research,
and classroom experimentation. More than 3,500 NetFPGA
systems have been deployed at over 300 institutions in
over 60 countries around the world.
Several hundred papers have been published: https://netfpga.org/Publications.html https://netfpga.org/Publications.html
- hardwaresofton 5y agoAlso just to add a tiny bit to this wealth of information: I just recently did an experiment on the difference between non-nitro and nitro-enabled (m4.xlarge vs. m5.xlarge) instances, in a production-ish trendy setup -- Ceph running on Kubernetes (managed by Rook), leveraged to run postgres and pgbench. The increase in performance was around +45% TPS, just from switching to the nitro enabled instance. The absolute amount of TPS wasn't high because the setup was untuned but simply switching created quite the difference. On top of all that, the Nitro instance was actually just slightly cheaper than the non-nitro instance. AWS hit it out of park in the making -- they've been working on it since 2014 supposedly and they certainly built something worth replicating.
- tiernano 5y agojust playing devil's advocate, that 45% is a little skewed though... the M4 instance was a "Intel Xeon E5-2676 v3 Haswell processor" (https://aws.amazon.com/blogs/aws/the-new-m4-instance-type-bonus-price-reduction-on-m3-c4/ https://aws.amazon.com/blogs/aws/the-new-m4-instance-type-bo...) and the M5 is a "Custom Intel® Xeon® Platinum 8175M series processors running at 2.5 GHz" (https://aws.amazon.com/blogs/aws/m5-the-next-generation-of-general-purpose-ec2-instances/ https://aws.amazon.com/blogs/aws/m5-the-next-generation-of-g...). so, you are jumping 2 generations from E5v3 to Gen 1 SP processors, plus going to custom processors for AWS (higher and more sustained turbo). I do agree that Nitro is a big change (less overhead for the hypervisor, faster IO and Networking, etc) but I wonder what the perf diff is just CPU upgrades...
- hardwaresofton 5y agoHey thanks for the note -- that's a good confounding factor I didn't take into account. > Based on Custom Intel® Xeon® Platinum 8175M series processors running at 2.5 GHz, the M5 instances are designed for highly demanding workloads and will deliver 14% better price/performance than the M4 instances on a per-core basis. If we take AWS at their word here, all other things equal 30% is a pretty decent result (with absolutely no tuning) -- I'll update the post with this caveat! All together though, this does still contribute to the point that Nitro is well worth the money.
- whizzter 5y ago"DPUs/SmartNICs are a partial industry response to AWS Nitro" This comment (as well as the article) is quite heavy on storage(?) specific terminology AND products so as someone who isn't into that area it all appears very opaque in meaning since there isn't any context on the what particularly this solves and why it's needed. I know I've made this error a bunch of times myself when writing, and it's ok when you have a very specific audience but for a wider audience like here you lose a lot of potential interest.
- walterbell 5y agoThe article includes an explainer: https://www.servethehome.com/what-is-a-dpu-a-data-processing-unit-quick-primer/ https://www.servethehome.com/what-is-a-dpu-a-data-processing... Line-rate (10G, 25G, 100G, 400Gbps) packet processing enables software control ("virtualization") of networking and storage. Instead of needing a human to make a physical connection between server and storage or network device, it can be automated via software. This saves money for data centers and allows new products to be launched quickly. It allows customer self-service for purchase and management of storage/network capacity. Line-rate packet processing also enables automated (authorized) intercept of storage and network traffic.