3 ms·
> This makes total sense but does it? Does Apple really have an application roadmap to ultimately utilize these tensor cores? Apple always does things in a hol
by alwillis 3y ago
> This makes total sense but does it? Does Apple really have an application roadmap to ultimately utilize these tensor cores?
Apple always does things in a holistic way. They wouldn't put these AI cores in their devices if they didn't also have a software strategy to go along with it.
Unlike with most companies, AI won't be bolted on; it'll well-integrated into the operating system.
For example, they've been working on LLMs[1]:
> We demonstrate large improvements over an existing system with similar functionality across different types of references, with our smallest model obtaining absolute gains of over 5% for on-screen references. We also benchmark against GPT-3.5 and GPT-4, with our smallest model achieving performance comparable to that of GPT-4, and our larger models substantially outperforming it.
And it's not going to require a terabyte of RAM either.
You can read the details: "ReALM: Reference Resolution As Language Modeling" [2]
There's also evidence of an AI browsing assistant for Safari. [3]
[1]: "Apple AI researchers boast useful on-device model that 'substantially outperforms' GPT-4"--https://9to5mac.com/2024/04/01/apple-ai-gpt-4/ https://9to5mac.com/2024/04/01/apple-ai-gpt-4/
[2]: https://arxiv.org/pdf/2403.20329.pdf https://arxiv.org/pdf/2403.20329.pdf
[3]: https://www.macrumors.com/2024/04/10/ios-18-safari-browsing-assistant-rumor/ https://www.macrumors.com/2024/04/10/ios-18-safari-browsing-...