5 ms·
AMD's CDNA 4 Architecture Announcement
- bee_rider 1y agoMachine learning is, of course, a massive market and everybody’s focus. But, does AMD just own the whole HPC stack at this point? (Or would they, if the software was there?). At least the individual nodes. What’s their equivalent to Infiniband?
- deleted 1y ago[deleted]
- phonon 1y agoUltra Ethernet https://www.tomshardware.com/networking/amd-deploys-its-first-ultra-ethernet-ready-network-card-pensando-pollara-provides-up-to-400-gbps-performance https://www.tomshardware.com/networking/amd-deploys-its-firs... https://semianalysis.com/2025/06/11/the-new-ai-networks-ultra-ethernet-uec-ualink-vs-broadcom-scale-up-ethernet-sue/ https://semianalysis.com/2025/06/11/the-new-ai-networks-ultr...
- OneDeuxTriSeiGo 1y agoIt's also worth noting Ultra Ethernet isn't just an AMD thing. The steering committee for the UEC is made up of basically every hardware manufacturer in the space except Nvidia. And of course Nvidia is a general contributor as well (presumably so they don't get left behind). https://ultraethernet.org/ https://ultraethernet.org/
- jauntywundrkind 1y agoAlso UltraEthernet went 1.0 (6d ago), had a decent sized comments: https://news.ycombinator.com/item?id=44249190 https://news.ycombinator.com/item?id=44249190
- wmf 1y agoCray Slighshot is even faster than Infiniband. Now that Nvidia is removing FP64 I assume AMD will have 100% of the HPC market until Fujitsu Monaka comes out.
- latchkey 1y agoWithin the node (gpu to gpu), it is infinity fabric. Externally, it is 8x400G NICs, which is the limitation of PCIeV5 anyway. We had a guy training SOTA models on 9 of our MI300x boxes just fine. Networking wasn't the slow bit.
- robjeiter 1y agoWhen looking at inference is AMD already on par with Nvidia?
- moondistance 1y agoYes, for many applications. Meta, OpenAI, Crusoe, and xAI recently announced large purchases of MI300 chips for inference. MI400, which will be available next year, also looks to be at least on par with Nvidia's roadmap.
- moondistance 1y ago(this is also why AMD popped 10% at open yesterday - this is a new development and talks from their 2025 "Advancing AI" event were published late last week + over the weekend)
- christkv 1y agoIs the software stack still lacking?
- moondistance 1y agoYes, big time, but there continues to be lots of progress. Most importantly, models are maturing, and this means less custom optimization is required.
- martinald 1y agoYes I'd agree with that. There is so much demand for inference which is maturing rapidly that even if a lot of the "R&D" is done on NVidia cards because of their (vastly, let's be fair) software stack, if AMD is competitive on the inference side (and perhaps more importantly have shorter lead times) then doing the inference on AMD is still an enormous market. I suspect we will (or already are?) at a point where 95%+ of GPUs are used for inference, not training.
- OneDeuxTriSeiGo 1y ago
- jauntywundrkind 1y agoFaster small matrix, for AI. Yup, that seems like good fit for what folks want. Supercharging the Local Data Share (LDS) that's shared by threads is really cool to hear about. 64 -> 160KB size. Writes into LDS go from 32B max to 128B, increasing throughout. Transposes, to help get the data in the right shape for its next use. Really really curious to see what the UDNA unified next gen architectures look like, if they really stick to merging Compute and Radeon CDNA and RDNA, as promised. If consumers end up getting multi-die compute solutions that would be neat & also intimidatingly hard (lots of energy spent keeping bits in sync across cores/coherency). After Navi 4X ended up having its flagship cancelled way back now, been wondering. I sort of expect that this won't scale as nicely as Epyc being a bunch of Ryzen dies. https://wccftech.com/amd-enthusiast-radeon-rx-8000-gpus-allegedly-featured-mcm-navi-4c-rdna-4-chips/ https://wccftech.com/amd-enthusiast-radeon-rx-8000-gpus-alle...
- icf80 1y agono UDNA ? any news ?
- incomingpain 1y agoI bought a radeon 9060. ROCM works. I'm getting ~40 tokens/sec out of Phi4: 14B BEWARE: I was running fully patched ubuntu 24 LTS and I needed to upgrade to ubuntu 24.10 and then ubuntu 25 before the drivers worked. Painful.