4 ms·

Apple.com advertising a Mac Mini: > Built for Apple Intelligence. > 16-core Neural Engine These Xcode release notes: > Claude in Xcode is now available in t

Apple.com advertising a Mac Mini: > Built for Apple Intelligence. > 16-core Neural Engine These Xcode release notes: > Claude in Xcode is now available in the Intelligence settings panel, allowing users to seamlessly add their existing paid Claude account to Xcode and start using Claude Sonnet 4 All that dedicated silicon taking up space on their SoC and yet you still have to input your credit card in order to use their IDE. Come on...

geor9e 1y ago
To run a model locally, they would need to release the weights to the public and their competitors. Those are flagship models. They would also need to shrink them way down to even fit. And even then, generating tokens on an apple neural chip would be waaaaaay slower than an HTTP request to a monster GPU in the sky. Local llms in my experience are either painfully dumb or painfully slow.
- hu3 1y ago
  Hence the "come on".
  - geor9e 1y ago
    Not if they knew how terrible it would be.
aetherspawn 1y ago
I bet Apple are working on it, it’s just not ready yet and they want to see how much people actually use it. It’s the Apple way to screw the 3rd party and replace with their own thing once the ROI is proven (not a criticism, this is a good approach for any business where the capex is large…)
jama211 1y ago
Trust me, you wouldn’t want to use a model for agentic code editing that could fit on a Mac mini at this stage.
- esafak 1y ago
  A 128GB Mac Mini M5 would be sweet.
deleted 1y ago
[deleted]
isodev 1y ago
"Apple Intelligence", at least the part that's available to developers via the Foundation Models framework is a tiny ~3B model [0] with very limited context window. It's mainly good for simple things like tagging/classification and small snippets of text. [0] https://github.com/fguzman82/apple-foundation-model-analysis https://github.com/fguzman82/apple-foundation-model-analysis
- alwillis 1y ago
  Yes, but the Foundation Model framework can seamlessly use Apple's much larger models via Private Cloud Compute or switch to ChatGPT. When macOS 26 is officially announced on September 9, I expect Apple to announce support for Anthropic and Google models.
jdgoesmarching 1y ago
Local models and any OpenAI-compatible APIs are available to the Xcode Beta assistant. This is just a dedicated “sign in with x” rather than manual configuration.
deleted 1y ago
[deleted]

geor9e 1y ago

To run a model locally, they would need to release the weights to the public and their competitors. Those are flagship models. They would also need to shrink them way down to even fit. And even then, generating tokens on an apple neural chip would be waaaaaay slower than an HTTP request to a monster GPU in the sky. Local llms in my experience are either painfully dumb or painfully slow.

hu3 1y ago
Hence the "come on".
- geor9e 1y ago
  Not if they knew how terrible it would be.

aetherspawn 1y ago

I bet Apple are working on it, it’s just not ready yet and they want to see how much people actually use it. It’s the Apple way to screw the 3rd party and replace with their own thing once the ROI is proven (not a criticism, this is a good approach for any business where the capex is large…)

jama211 1y ago

Trust me, you wouldn’t want to use a model for agentic code editing that could fit on a Mac mini at this stage.

esafak 1y ago
A 128GB Mac Mini M5 would be sweet.

deleted 1y ago

[deleted]

isodev 1y ago

"Apple Intelligence", at least the part that's available to developers via the Foundation Models framework is a tiny ~3B model [0] with very limited context window. It's mainly good for simple things like tagging/classification and small snippets of text. [0] https://github.com/fguzman82/apple-foundation-model-analysis https://github.com/fguzman82/apple-foundation-model-analysis

alwillis 1y ago
Yes, but the Foundation Model framework can seamlessly use Apple's much larger models via Private Cloud Compute or switch to ChatGPT. When macOS 26 is officially announced on September 9, I expect Apple to announce support for Anthropic and Google models.

jdgoesmarching 1y ago

Local models and any OpenAI-compatible APIs are available to the Xcode Beta assistant. This is just a dedicated “sign in with x” rather than manual configuration.

deleted 1y ago

[deleted]