4 ms·
Most of it is a mix of local functionality using their in-house hardware-optimized LLM models (which is why the compatible iPhone models are limited) and a whol
by crooked-v 2y ago
Most of it is a mix of local functionality using their in-house hardware-optimized LLM models (which is why the compatible iPhone models are limited) and a whole server architecture they've built out to, in theory, provide secure off-device functionality (all the buzzwords about data being encrypted in flight, server storage being ephemeral per session, etc).
OpenAI functionality is also included for when the Apple LLM(s) decide that they can't handle a query (no info has been given on how that's determined), but it specifically requires consent from the user (every time) to happen.
- dwaite 2y agoI'd actually say it is more that "World Model" queries ("what was the cause of the American Civil War") are just something Apple doesn't see value in doing themselves. This is even more an issue when you look at the reputational harm and potential liability of giving a poor answer when someone asks about "do-it-yourself home vasectomy options"