4 ms·
I'm not clear on what precisely the Neural Engine can do, but Apple has put plenty of resources into improving their GPUs, which can definitely do compute well
by TillE 3y ago
I'm not clear on what precisely the Neural Engine can do, but Apple has put plenty of resources into improving their GPUs, which can definitely do compute well (see eg, MacWhisper).
- conjecTech 3y agoYeah, it could be that they plan to do #3 through use of their chunky GPUs. There is definitely a lot of focus on the whole APU concept. From look at some of the dies and what projects like ggml have been able to do through mixed computation, I'm guessing the neural engine is ~3-5x the throughput/area vs GPU for the kinds of operations its doing. Trying to map neural nets onto graphics seems reasonable, but personally I would bet on neuralizing graphics to be the better strategy long term.