2 ms·
Apple Intelligence uses Google TPUs instead of GPUs.
by walterbell 2y ago
Apple Intelligence uses Google TPUs instead of GPUs.
- j16sdiz 2y agoIf you read all their paper, they use a mix of them
- bigcat12345678 2y agoThat's something not surprising, given JG and Ruoming's Google stint. Google is going to dominate LLM ushered AI era. Google has been AI first since 2016, they just don't have the opening. Sam, as inapt at engineering, just has no idea how to navigate the delicate biz & eng competitions.
- dlewis1788 2y agoFor training, yes, but no indications on inference workloads. Apple has said they would use their own silicon for inference in the cloud.
- walterbell 2y agoPlus the Apple "Neural Engine" which has shipped on millions of iPhones for local inference.