5 ms·

Not billion(s), because Apple Intelligence will only work on Apple Silicon (Mx) Mac and iPad and iPhone 15 Pro. Also, initially only in en_US devices. I’ve hea

by rpgbr 2y ago

Not billion(s), because Apple Intelligence will only work on Apple Silicon (Mx) Mac and iPad and iPhone 15 Pro. Also, initially only in en_US devices. I’ve heard 100 mi figure, but can’t confirm/remember where.

aurareturn 2y ago
Do Siri queries not fall back to GPT4o in older devices? That seems weird because the inference is done in the cloud. But 100m figure seems small. There are ~100m Apple Silicon Macs sold in the last 4 years. That's not including any M1+ iPads or iPhone 15 Pros. I'm guessing maybe 250m? Still a ton of queries and usage. It's not just Siri. I believe features like optimize email response also uses GPT4o.
- ben_w 2y ago
  Sure, but they're not all en_US. I've got three on my desk right now*, and I'm in Germany. * got one of my own right before a previous employer closed down and let us keep the work one, third one is from new employer
  - aurareturn 2y ago
    Apple Intelligence won't be limited to en_US right? It should be available world wide.
    - ben_w 2y ago
      Eventually, but not initially. I read this thread as if it was about the initial release, not the end-state. (Given how rapidly AI changes, anything more than a year away isn't easily planned for, even assuming no surprises on the anti-trust front for every Big Tech company nor any surprise new legal obligations for AI).
    - d3m0t3p 2y ago
      Does it need to be sold in the US or simply chaning os settings to use the en_US language is enough to activate this ? I'm in europe but working mostly in english and therfore I set my mac in english. Could I use Apple Intelligence ?
      - tedmiston 2y ago
        Per Apple's site [1], it's just the language setting: "* Apple Intelligence will be available in beta on iPhone 15 Pro, iPhone 15 Pro Max, and iPad and Mac with M1 and later, with Siri and device language set to U.S. English, as part of iOS 18, iPadOS 18, and macOS Sequoia this fall." [1]: https://www.apple.com/apple-intelligence/ https://www.apple.com/apple-intelligence/
- jitl 2y ago
  Email, etc, is all Apple inference, the presentation strongly implied that was on-device. The system always explicitly asks “Ok to send this query to OpenAI?” or user initiated request. I think the Apple server inference is handling things like image generation where you need a beefy guy to get results quickly, and don’t need to transmit as much user context to service the request.
  - aurareturn 2y ago
    I'm pretty sure there is an option to ask ChatGPT to do inferencing for Email, etc. If I'm a paid ChatGPT user, I'd definitely choose GPT4 over Apple's models.
    - slipheen 2y ago
      There isn't anything like that currently - The integration that's been announced/shown is more like the current fallback in Siri of "Would you like me to Google that for you?"
      - Aerbil313 2y ago
        No, there is - from official Apple Intelligence announcement: > With ChatGPT from OpenAI integrated into Siri and Writing Tools, you get even more expertise when it might be helpful for you — no need to jump between tools. Siri can tap into ChatGPT for certain requests, including questions about photos or documents. And with Compose in Writing Tools, you can create and illustrate original content from scratch. https://www.apple.com/apple-intelligence/ https://www.apple.com/apple-intelligence/
      - aurareturn 2y ago
        I watched WWDC and clearly, GPT4 is an option for inferencing email/text at the OS level. It's not just Siri fallback.
- blixt 2y ago
  They’ve been explicit that only some knowledge related requests get sent to OpenAI, and only after the user has been asked “ok to send this to ChatGPT?” If they allowed your private email contents or any other private context to leak outside their encrypted enclave (local or their new online hardware) then the entire set of privacy claims would go out the window.
quenix 2y ago
There are three models: 1. Apple On-Device 2. Apple Server 3. GPT-4o Apple Silicon/Mx, iPad, iPhone 15 Pro can access all three. All other devices can still access Apple Server and GPT-4o. So, I'd expect the incompatible devices to actually hammer OpenAI more.
- abhinavk 2y ago
  Other devices are not getting Apple Intelligence.
  - ilogik 2y ago
    Apple Intelligence doesn't use OpenAI
    - cassianoleal 2y ago
      > As a result of the company's partnership with OpenAI, Apple Intelligence includes an integration with ChatGPT, allowing Siri to determine when to send certain complex user requests to ChatGPT. https://en.wikipedia.org/wiki/Apple_Intelligence https://en.wikipedia.org/wiki/Apple_Intelligence
      - fckgw 2y ago
        OpenAI does not power Apple Intelligence. Apple Intelligence will pass of queries to OpenAI (with explicit user permission) in certain circumstances where it feels OpenAI would have a better answer.
        cassianoleal 2y ago
        > OpenAI does not power Apple Intelligence. This is a strawman. No one on this thread said it does. That said, it does - even if only partially, even if only with explicit permission, even if only in certain circumstances.
        talldayo 2y ago

by rpgbr 2y ago

aurareturn 2y ago

Do Siri queries not fall back to GPT4o in older devices? That seems weird because the inference is done in the cloud. But 100m figure seems small. There are ~100m Apple Silicon Macs sold in the last 4 years. That's not including any M1+ iPads or iPhone 15 Pros. I'm guessing maybe 250m? Still a ton of queries and usage. It's not just Siri. I believe features like optimize email response also uses GPT4o.

ben_w 2y ago
Sure, but they're not all en_US. I've got three on my desk right now*, and I'm in Germany. * got one of my own right before a previous employer closed down and let us keep the work one, third one is from new employer
- aurareturn 2y ago
  Apple Intelligence won't be limited to en_US right? It should be available world wide.
  - ben_w 2y ago
    Eventually, but not initially. I read this thread as if it was about the initial release, not the end-state. (Given how rapidly AI changes, anything more than a year away isn't easily planned for, even assuming no surprises on the anti-trust front for every Big Tech company nor any surprise new legal obligations for AI).
  - d3m0t3p 2y ago
    Does it need to be sold in the US or simply chaning os settings to use the en_US language is enough to activate this ? I'm in europe but working mostly in english and therfore I set my mac in english. Could I use Apple Intelligence ?
    - tedmiston 2y ago
      Per Apple's site [1], it's just the language setting: "* Apple Intelligence will be available in beta on iPhone 15 Pro, iPhone 15 Pro Max, and iPad and Mac with M1 and later, with Siri and device language set to U.S. English, as part of iOS 18, iPadOS 18, and macOS Sequoia this fall." [1]: https://www.apple.com/apple-intelligence/ https://www.apple.com/apple-intelligence/
jitl 2y ago
Email, etc, is all Apple inference, the presentation strongly implied that was on-device. The system always explicitly asks “Ok to send this query to OpenAI?” or user initiated request. I think the Apple server inference is handling things like image generation where you need a beefy guy to get results quickly, and don’t need to transmit as much user context to service the request.
- aurareturn 2y ago
  I'm pretty sure there is an option to ask ChatGPT to do inferencing for Email, etc. If I'm a paid ChatGPT user, I'd definitely choose GPT4 over Apple's models.
  - slipheen 2y ago
    There isn't anything like that currently - The integration that's been announced/shown is more like the current fallback in Siri of "Would you like me to Google that for you?"
    - Aerbil313 2y ago
      No, there is - from official Apple Intelligence announcement: > With ChatGPT from OpenAI integrated into Siri and Writing Tools, you get even more expertise when it might be helpful for you — no need to jump between tools. Siri can tap into ChatGPT for certain requests, including questions about photos or documents. And with Compose in Writing Tools, you can create and illustrate original content from scratch. https://www.apple.com/apple-intelligence/ https://www.apple.com/apple-intelligence/
    - aurareturn 2y ago
      I watched WWDC and clearly, GPT4 is an option for inferencing email/text at the OS level. It's not just Siri fallback.
blixt 2y ago
They’ve been explicit that only some knowledge related requests get sent to OpenAI, and only after the user has been asked “ok to send this to ChatGPT?” If they allowed your private email contents or any other private context to leak outside their encrypted enclave (local or their new online hardware) then the entire set of privacy claims would go out the window.

quenix 2y ago

There are three models: 1. Apple On-Device 2. Apple Server 3. GPT-4o Apple Silicon/Mx, iPad, iPhone 15 Pro can access all three. All other devices can still access Apple Server and GPT-4o. So, I'd expect the incompatible devices to actually hammer OpenAI more.

abhinavk 2y ago
Other devices are not getting Apple Intelligence.
- ilogik 2y ago
  Apple Intelligence doesn't use OpenAI
  - cassianoleal 2y ago
    > As a result of the company's partnership with OpenAI, Apple Intelligence includes an integration with ChatGPT, allowing Siri to determine when to send certain complex user requests to ChatGPT. https://en.wikipedia.org/wiki/Apple_Intelligence https://en.wikipedia.org/wiki/Apple_Intelligence
    - fckgw 2y ago
      OpenAI does not power Apple Intelligence. Apple Intelligence will pass of queries to OpenAI (with explicit user permission) in certain circumstances where it feels OpenAI would have a better answer.
      - cassianoleal 2y ago
        > OpenAI does not power Apple Intelligence. This is a strawman. No one on this thread said it does. That said, it does - even if only partially, even if only with explicit permission, even if only in certain circumstances.
      - talldayo 2y ago