4 ms·

I'm confused now... Apple's other announcement today discussed on-device AI. So what sorts of queries will be on-device and what will be sent to OpenAI? How do

I'm confused now... Apple's other announcement today discussed on-device AI. So what sorts of queries will be on-device and what will be sent to OpenAI? How does this distinction appear in the UI?

sunnybeetroot 2y ago
It’s in the keynote video.
- solardev 2y ago
  Ah, thanks. Not in a place where I can watch video right now, but will check it out later.
noahtallen 2y ago
I think the headlines are REALLY muddying things. From watching the Keynote, most of Apple Intelligence is their own stuff, mostly on-device. Siri explicitly asks you if you want to use chatGPT to answer a query. It does so when it thinks chatGPT will have a better answer. It sounds like that will be for very creative/generative types of things like "please create a 4 course meal with xyz foods," at which point Siri asks you if you want to use chatGPT. It will be very clear, according to Apple.
- lxgr 2y ago
  That said, the Apple Intelligence vs. OpenAI distinction seems much clearer than the Apple cloud vs. local distinction, which I find somewhat concerning. Sure, the Apple cloud is ultra-secure and private and all, but I'd still like to know what happens where without having to test it myself by enabling airplane mode and seeing what still works.
  - noahtallen 2y ago
    Yeah, that's a great point. At the same time, it only takes a couple YouTubers/researchers to do some testing for us to know the answer
etchalon 2y ago
When you ask Siri a question, it will prompt you to ask whether it can send your query/data to ChatGPT. All other AI features within the OS are powered by Apple's Private Compute Cloud, which is Apple's code running on Apple's chips at Apple's Data Center.
- noahtallen 2y ago
  > All other AI features within the OS are powered by Apple's Private Compute Cloud Clarification: All other AI features within the OS are powered by on device models which can reach out to the private cloud for larger workflows & models.

I'm confused now... Apple's other announcement today discussed on-device AI. So what sorts of queries will be on-device and what will be sent to OpenAI? How does this distinction appear in the UI?

sunnybeetroot 2y ago

It’s in the keynote video.

solardev 2y ago
Ah, thanks. Not in a place where I can watch video right now, but will check it out later.

noahtallen 2y ago

I think the headlines are REALLY muddying things. From watching the Keynote, most of Apple Intelligence is their own stuff, mostly on-device. Siri explicitly asks you if you want to use chatGPT to answer a query. It does so when it thinks chatGPT will have a better answer. It sounds like that will be for very creative/generative types of things like "please create a 4 course meal with xyz foods," at which point Siri asks you if you want to use chatGPT. It will be very clear, according to Apple.

lxgr 2y ago
That said, the Apple Intelligence vs. OpenAI distinction seems much clearer than the Apple cloud vs. local distinction, which I find somewhat concerning. Sure, the Apple cloud is ultra-secure and private and all, but I'd still like to know what happens where without having to test it myself by enabling airplane mode and seeing what still works.
- noahtallen 2y ago
  Yeah, that's a great point. At the same time, it only takes a couple YouTubers/researchers to do some testing for us to know the answer

etchalon 2y ago

When you ask Siri a question, it will prompt you to ask whether it can send your query/data to ChatGPT. All other AI features within the OS are powered by Apple's Private Compute Cloud, which is Apple's code running on Apple's chips at Apple's Data Center.

noahtallen 2y ago
> All other AI features within the OS are powered by Apple's Private Compute Cloud Clarification: All other AI features within the OS are powered by on device models which can reach out to the private cloud for larger workflows & models.