6 ms·
Email, etc, is all Apple inference, the presentation strongly implied that was on-device. The system always explicitly asks “Ok to send this query to OpenAI?” o
by jitl 2y ago
Email, etc, is all Apple inference, the presentation strongly implied that was on-device. The system always explicitly asks “Ok to send this query to OpenAI?” or user initiated request.
I think the Apple server inference is handling things like image generation where you need a beefy guy to get results quickly, and don’t need to transmit as much user context to service the request.
- aurareturn 2y agoI'm pretty sure there is an option to ask ChatGPT to do inferencing for Email, etc. If I'm a paid ChatGPT user, I'd definitely choose GPT4 over Apple's models.
- slipheen 2y agoThere isn't anything like that currently - The integration that's been announced/shown is more like the current fallback in Siri of "Would you like me to Google that for you?"
- Aerbil313 2y agoNo, there is - from official Apple Intelligence announcement: > With ChatGPT from OpenAI integrated into Siri and Writing Tools, you get even more expertise when it might be helpful for you — no need to jump between tools. Siri can tap into ChatGPT for certain requests, including questions about photos or documents. And with Compose in Writing Tools, you can create and illustrate original content from scratch. https://www.apple.com/apple-intelligence/ https://www.apple.com/apple-intelligence/
- aurareturn 2y agoI watched WWDC and clearly, GPT4 is an option for inferencing email/text at the OS level. It's not just Siri fallback.