> It really is that hard YES!! Thank you! > Nvidia's real victory (besides leading on performance-per-watt) is that their software stack doesn't suck YES! An

> It really is that hard YES!! Thank you! > Nvidia's real victory (besides leading on performance-per-watt) is that their software stack doesn't suck YES! And it's not just CUDA and CUDA-adjacent tools, but also their cuDNN/cuBLAS/etc. libraries. They invest a massive amount of staffing into squeezingt the last drop of performance out of their hardware, identifying areas for improvement and feeding that back to the architects. > Apple wrote the OpenCL spec for exactly that purpose and gave it to Khronos Nitpick: Affie Munshi from Apple wrote down a draft and convinced his management to offer it to Khronos, where it was significantly modified over... was it a year or so?... by a number of representatives from a dozen companies or so. A ton of smart people contributed a ton of work into what became the 1.0 version. And let me tell you that the discussions were often tense, both during the official meetings as well as what happened behind the scenes. The end result was as good as you can expect from a large committee composed of representatives from competing companies. But, in summary, you get it, unlike so many commenters in HN.