Actually their real advantage is the large set of highly optimised CUDA kernels. This is the thing that lets them outperform AMD chips even on inferior hardwar

Actually their real advantage is the large set of highly optimised CUDA kernels. This is the thing that lets them outperform AMD chips even on inferior hardware. And the fact that anything new gets written for CUDA first. There is OpenAI's Triton language for this too and people are beginning to use it (shout out to Unsloth here!). > Reserved fab space. While this is true, it's worth noting that the inference only Groq chip which gets 2x-5x better LLM inference performance is on a 12nm process.