3 ms·
Unfortunately AMD totally missed the boat on ML. I think by this measure so did everyone else. Nvidia pushed cuda, and everyone took it, even though 8 or so ye
by StillBored 6y ago
Unfortunately AMD totally missed the boat on ML.
I think by this measure so did everyone else. Nvidia pushed cuda, and everyone took it, even though 8 or so years ago openCL was a reasonable competitor. But various orgs choose to make a proprietary technology a first class citizen rather than putting the effort into an open alternative. Big win for nvidia, big loss for everyone else not large enough to create their own ML frameworks and accelerators.
- dragontamer 6y agoIts not really about CUDA or OpenCL. Its about the choice to support FP16 matrix-multiplication at the assembly level of NVidia chips. When you build a processor that literally has "do 4x4 matrix multiplication" as an assembly statement, you'll get far superior ML performance compared to everyone else. (Except Google's TPUs, which have larger matrix-multiplication arrays)