4 ms·
I guess Apple is using their custom silicon? That was a major payoff for Apple - I wonder if any of the other fangs will actually be able to follow suit.
by bhawks 2y ago
I guess Apple is using their custom silicon?
That was a major payoff for Apple - I wonder if any of the other fangs will actually be able to follow suit.
- xuancanh 2y agoApple uses TPUs on Google Cloud Platform. https://www.cnbc.com/2024/07/29/apple-says-its-ai-models-were-trained-on-googles-custom-chips-.html https://www.cnbc.com/2024/07/29/apple-says-its-ai-models-wer...
- ceejayoz 2y agoAnd a weird deal with OpenAI (which I think would show up as Microsoft for the actual physical hardware). https://openai.com/index/openai-and-apple-announce-partnership/ https://openai.com/index/openai-and-apple-announce-partnersh...
- SSLy 2y agofor training, but for the interference apparently they use their own chips
- talldayo 2y agoExcept in cases where responses are outsourced from OpenAI. All the ChatGPT-based inference likely happens on Nvidia hardware too.
- bigyikes 2y agoIs there evidence that Apple is training a model large enough to require a huge amount of compute?
- dialup_sounds 2y agohttps://arxiv.org/abs/2407.21075 https://arxiv.org/abs/2407.21075 AFM-server was trained on 8192 TPUv4 chips Someone more versed can say if that is huge or not.
- mafuy 2y agoIt is a far larger scale than most high performance clusters offer.