4 ms·
> like everyone else but Apple, on Nvidia (InfiniBand) Google also does not depend on NVIDIA, thx to TPUs. Rents NVIDIA GPUs to external customers - sure, it's
by krasin 2y ago
> like everyone else but Apple, on Nvidia (InfiniBand)
Google also does not depend on NVIDIA, thx to TPUs. Rents NVIDIA GPUs to external customers - sure, it's a nice side business, but internally TPUs are king and there's no dependency on NVIDIA for that.
- morepork 2y agoLikewise Microsoft and Meta have developed in house AI chips, but I don't know what fraction of their AI workloads run on them.
- theincredulousk 2y agoNot a meaningful amount :). Their “AI chips” are, for now, marketing.
- SuchAnonMuchWow 2y agoFrom what I know, Meta AI chips are used in production today, but are made for their recommendations tasks which is a very different IA than GPTs and LLMs for which they still rely on GPUs.
- theincredulousk 2y agoTPUs are essentially garbage compared to NVIDIA hardware. TPUs are king of nothing, but a primary ingredient in Kool-Aid
- foobiekr 2y agoThis is not true at all.
- krasin 2y agoIt's very hard to respond to a comment like that, since there's no specifics, just a plain disagreement. On my side, I would like to point that the today HN thread ([1]) that discusses a paper GameNGen ([2]) that runs Doom with diffusion models was trained on TPUs. I don't see a dependency on NVIDIA there. If there's a more specific rebuttal to my original statement, please, don't hesitate to state it. 1. https://news.ycombinator.com/item?id=41375548 https://news.ycombinator.com/item?id=41375548 2. https://gamengen.github.io/ https://gamengen.github.io/ 3. https://arxiv.org/abs/2408.14837 https://arxiv.org/abs/2408.14837
- KaiserPro 2y ago> Google also does not depend on NVIDIA, Deepmind says otherwise. training is most likley all on NVIDIA still. Same for Apple. The difference is, nobody knows for sure with Apple, because they are a secrecy cult.