5 ms·

I think the biggest announcement was the private compute cloud with Apple Silicon. Apple is building up internal expertise to go after Nvidia.

dmix 2y ago
Can you explain what that means for someone who missed part of the video today?
- theshrike79 2y ago
  The Apple Intelligence cloud system uses Apple's own M-series chips, not Nvidia.
  - ismepornnahi 2y ago
    Because they will be running inference using much smaller models than GPT 4.
    - int_19h 2y ago
      At least they are honest about it in the specs that they have published - there's a graph there that clearly shows their server-side model underperforming GPT-4. A refreshing change from the usual "we trained a 7B model and it's almost as good as GPT-4 in tests" hype train. (see "Apple Foundation Model Human Evaluation" here: https://machinelearning.apple.com/research/introducing-apple-foundation-models https://machinelearning.apple.com/research/introducing-apple...)
      - theshrike79 2y ago
        Yea, their models are more targeted. You can't ask Apple Intelligence/Siri about random celebrities or cocktail recipes. But you CAN ask it to show you all pictures you took of your kids during your vacation to Cabo in 2023 and it'll find them for you. The model "underperforms", but not in the ways that matter. This is why they partnered with OpenAI, to get the generic stuff included when people need it.
yborg 2y ago
Isn't it also that Nvidia chips are basically unobtainable right now anyway?
- solarmist 2y ago
  Yeah, but Apple wouldn’t care either way. They do things for the principle of it. “We have an ongoing beef with NVIDIA so we’ll build our own ai server farms.”
teruakohatu 2y ago
Apple have a long antagonist relationship with NVIDIA. If anything it is holding Apple back because they don’t want to go cap in hand to NVIDIA and say “please sir, can I have some more”. We see this play out with the ChatGPT integration. Rather than hosting GPT-4o themselves, OpenAI are. Apple is providing NVIDIA powered AI models through a third party, somewhat undermining the privacy first argument.
- hmottestad 2y ago
  Rumours say that Apple has bought a lot of GPUs from Nvidia in the last year or so in order to train their own models.
- s3p 2y ago
  Not really. They use ChatGPT as a last resort for a question that isn't related to the device or an Apple-related interaction. Ex: "Make a recipe out of the foods in this image" versus "how far away is my mom from the lunch spot she told me about". And in that instance they ask the user explicitly whether they want to use ChatGPT.

dmix 2y ago

Can you explain what that means for someone who missed part of the video today?

theshrike79 2y ago
The Apple Intelligence cloud system uses Apple's own M-series chips, not Nvidia.
- ismepornnahi 2y ago
  Because they will be running inference using much smaller models than GPT 4.
  - int_19h 2y ago
    At least they are honest about it in the specs that they have published - there's a graph there that clearly shows their server-side model underperforming GPT-4. A refreshing change from the usual "we trained a 7B model and it's almost as good as GPT-4 in tests" hype train. (see "Apple Foundation Model Human Evaluation" here: https://machinelearning.apple.com/research/introducing-apple-foundation-models https://machinelearning.apple.com/research/introducing-apple...)
    - theshrike79 2y ago
      Yea, their models are more targeted. You can't ask Apple Intelligence/Siri about random celebrities or cocktail recipes. But you CAN ask it to show you all pictures you took of your kids during your vacation to Cabo in 2023 and it'll find them for you. The model "underperforms", but not in the ways that matter. This is why they partnered with OpenAI, to get the generic stuff included when people need it.

yborg 2y ago

Isn't it also that Nvidia chips are basically unobtainable right now anyway?

solarmist 2y ago
Yeah, but Apple wouldn’t care either way. They do things for the principle of it. “We have an ongoing beef with NVIDIA so we’ll build our own ai server farms.”

teruakohatu 2y ago

Apple have a long antagonist relationship with NVIDIA. If anything it is holding Apple back because they don’t want to go cap in hand to NVIDIA and say “please sir, can I have some more”. We see this play out with the ChatGPT integration. Rather than hosting GPT-4o themselves, OpenAI are. Apple is providing NVIDIA powered AI models through a third party, somewhat undermining the privacy first argument.

hmottestad 2y ago
Rumours say that Apple has bought a lot of GPUs from Nvidia in the last year or so in order to train their own models.
s3p 2y ago
Not really. They use ChatGPT as a last resort for a question that isn't related to the device or an Apple-related interaction. Ex: "Make a recipe out of the foods in this image" versus "how far away is my mom from the lunch spot she told me about". And in that instance they ask the user explicitly whether they want to use ChatGPT.