3 ms·

It's not been clear to me whether siri will integrate "AI" capabilities locally or whether it will simply be a fancy wrapper around chatGPT API - I suspect the

It's not been clear to me whether siri will integrate "AI" capabilities locally or whether it will simply be a fancy wrapper around chatGPT API - I suspect the latter.

crooked-v 2y ago
Most of it is a mix of local functionality using their in-house hardware-optimized LLM models (which is why the compatible iPhone models are limited) and a whole server architecture they've built out to, in theory, provide secure off-device functionality (all the buzzwords about data being encrypted in flight, server storage being ephemeral per session, etc). OpenAI functionality is also included for when the Apple LLM(s) decide that they can't handle a query (no info has been given on how that's determined), but it specifically requires consent from the user (every time) to happen.
- dwaite 2y ago
  I'd actually say it is more that "World Model" queries ("what was the cause of the American Civil War") are just something Apple doesn't see value in doing themselves. This is even more an issue when you look at the reputational harm and potential liability of giving a poor answer when someone asks about "do-it-yourself home vasectomy options"
halJordan 2y ago
It's probably not clear for the same reason you're quoting AI. Nevertheless Apple has said, clearly, that its AI capabilities will be both local and online, and sometimes, will just wrap the chatgpt api. The really sad thing is that Apple is doing really cool, really difficult, hacker-y shit just to make this all work while you and others are just ignoring it to virtue signaling ... being a Luddite?
- hbn 2y ago
  > will just wrap the chatgpt api Just to clarify, it's not even Siri wrapping Chat GPT really. It's essentially just a "dumb" integration where if Siri thinks it can't handle a request, it'll prompt you to send it to Chat GPT instead. If it ever wants to send anything off to Chat GPT it'll ask you first, and from there it doesn't pretend to be Siri. There's a very obvious line drawn, it's just a convenience feature that makes it so you don't have to go into the Chat GPT app if Siri can't help you.

It's not been clear to me whether siri will integrate "AI" capabilities locally or whether it will simply be a fancy wrapper around chatGPT API - I suspect the latter.

crooked-v 2y ago

Most of it is a mix of local functionality using their in-house hardware-optimized LLM models (which is why the compatible iPhone models are limited) and a whole server architecture they've built out to, in theory, provide secure off-device functionality (all the buzzwords about data being encrypted in flight, server storage being ephemeral per session, etc). OpenAI functionality is also included for when the Apple LLM(s) decide that they can't handle a query (no info has been given on how that's determined), but it specifically requires consent from the user (every time) to happen.

dwaite 2y ago
I'd actually say it is more that "World Model" queries ("what was the cause of the American Civil War") are just something Apple doesn't see value in doing themselves. This is even more an issue when you look at the reputational harm and potential liability of giving a poor answer when someone asks about "do-it-yourself home vasectomy options"

halJordan 2y ago

It's probably not clear for the same reason you're quoting AI. Nevertheless Apple has said, clearly, that its AI capabilities will be both local and online, and sometimes, will just wrap the chatgpt api. The really sad thing is that Apple is doing really cool, really difficult, hacker-y shit just to make this all work while you and others are just ignoring it to virtue signaling ... being a Luddite?

hbn 2y ago
> will just wrap the chatgpt api Just to clarify, it's not even Siri wrapping Chat GPT really. It's essentially just a "dumb" integration where if Siri thinks it can't handle a request, it'll prompt you to send it to Chat GPT instead. If it ever wants to send anything off to Chat GPT it'll ask you first, and from there it doesn't pretend to be Siri. There's a very obvious line drawn, it's just a convenience feature that makes it so you don't have to go into the Chat GPT app if Siri can't help you.