3 ms·
This is essentially what Windows Copilot seems to be attempting to do currently. There's obviously downsides to this approach from a security concern - it doesn
by jjcm 3y ago
This is essentially what Windows Copilot seems to be attempting to do currently. There's obviously downsides to this approach from a security concern - it doesn't live on device, it's on the cloud.
I actually think Apple is incredibly positioned here. All of their devices have dedicated NPUs, if they can optimize an LLM to run locally on these in a way that's performant/accurate, the power could be incredible for a local AI that helps out. It'd likely be a huge sales driver as well - Pro devices might have faster/more accurate AI assistants. If it's purely local, the access to personal data becomes less of a concern. Super curious to see how this evolves.
- JohnMakin 3y agoApple's first foray into this kind of tech would have been siri, but they made the baffling decision to send siri requests to their servers and back rather than running locally. I know at some point that changed a while back, can't remember when, but siri is still so bad at doing/understanding very basic things that my confidence in apple is not super high to wield this tech.
- tick_tock_tick 3y ago> I actually think Apple is incredibly positioned here. Does Apple even have an AI story? Siri is still the worst of the lot for voice. I don't think they are doing anything in the LLM space so....?
- flangola7 3y agoThere's all the ML features that have that Android and windows are still catching up to. Let me know when I can search for that paper document I took a photo of by ctrl+f for a string I remember in it.