3 ms·
Apple likely plans to use their own infrastructure [0], and why should they add a major competitor as a middleman? [0] https://www.reuters.com/technology/apple
by layer8 2y ago
Apple likely plans to use their own infrastructure [0], and why should they add a major competitor as a middleman?
[0] https://www.reuters.com/technology/apple-power-ai-servers-with-its-chips-bloomberg-news-reports-2024-05-09/ https://www.reuters.com/technology/apple-power-ai-servers-wi...
- ninjha01 2y agoI can’t imagine apple has chip production scaled to the point it could support all the inference queries coming from all the iPhones
- c1sc0 2y agoThey don’t need to if they can process a significant chunk of the queries on-device. Llama3-level inference works fine on M2-level chips today and the M4 is already in a mobile device.
- talldayo 2y ago> Apple will deliver some of its upcoming artificial intelligence features this year through data centers powered by its own in-house chips Emphasis mine. I don't think there's any chance that means ChatGPT will run on Apple Silicon. It seems more likely that they will use it to power their internal CoreML/MLX-based research, anything more would kinda be a waste of money and electricity.