4 ms·

So Apple’s AI acceleration and memory architecture is accidental, but nvidia’s is not?

• bigyabai 6mo ago
  Nvidia has research papers on accelerating Machine Learning as far back as 2014: https://research.nvidia.com/publications?f%5B0%5D=research_area%3A26 https://research.nvidia.com/publications?f%5B0%5D=research_a...
  • jbverschoor 6mo ago
    Apple's website from 2017 https://machinelearning.apple.com/research?page=1&sort=oldest https://machinelearning.apple.com/research?page=1&sort=oldes... That's also the year where they released on-chip acceleration for certain things, so they probably started a year or 2 before working on that tech? Not as accidental as assumed.
    • bigyabai 6mo ago
      Apple's Neural Engine from 2017 is an NPU that's basically obsolete today in light of Metal Compute Shaders. It was accidental, and Apple is redesigning their GPU architecture to subsume it. CUDA on the other hand continues to be relevant, and the compute capabilities from 2014 are still instrumental for accelerating training and acceleration workloads.