3 ms·
First NPU arrived 7 years ago in an iPhone SoC. GPUs are also “AI” chips. Local LLM community has been using Apple Silicon Mac GPUs to do inference. I’m sure
by aurareturn 2y ago
First NPU arrived 7 years ago in an iPhone SoC. GPUs are also “AI” chips.
Local LLM community has been using Apple Silicon Mac GPUs to do inference.
I’m sure Apple Intelligence uses the NPU and maybe the GPU sometimes.