3 ms·
> most people have no use for that Apple originally added their NPUs before the current LLM wave to support things like indexing your photo library so that obj
by kalleboo 2y ago
> most people have no use for that
Apple originally added their NPUs before the current LLM wave to support things like indexing your photo library so that objects and people are searchable. These features are still very popular. I don't think these NPUs are fast enough for GenAI anyway.
- wmf 2y agoMS Copilot and "Apple Intelligence" are running a small language model and image generation on the NPU so that should count as "GenAI".
- kalleboo 2y agoIt's still in beta so we'll see how things go but I saw someone testing what Apple Intelligence ran on-device vs sent off to the "private secure cloud" and even stuff like text summaries were being sent to the cloud.
- grugagag 2y agoI wish I could turn that off on my phone.