5 ms·

I think this is just Apple planning for their on-device models getting better, which makes sense given they have access to Gemini now. If developers use this fo

by mcintyre1994 4mo ago

I think this is just Apple planning for their on-device models getting better, which makes sense given they have access to Gemini now. If developers use this for all their code calling an external LLM, then as Apple's model becomes more capable and covers more use cases it'll be easy to switch to it at individual call sites. That'll give apps better UX and save developers money on a bill that Apple doesn't get a cut of.

embedding-shape 4mo ago
> That'll give apps better UX and save developers money on a bill that Apple doesn't get a cut of. With other words, it's unlikely to happen as there is no money in it. Better for Apple to create some new subscription "AI" and "AI-lite" plans people can subscribe to, and since Apple is a company and we all know what those care about, it's unlikely to become a utopia of local models running on your phone.
criddell 4mo ago
How does using Gemini lead to better on-device models?
- halJordan 4mo ago
  Apple is distilling models from gemini
- Danox 4mo ago
  Gemini is just a stopgap like using Intel processors or Qualcomm modems.
Danox 4mo ago
UX is just another word for ecosystem building, which is what Apple does best in comparison to their competition and also doesn’t hurt to do hardware to go along with it. Microsoft and Nvidia aren’t teaming up for nothing.