5 ms·
OK but vertical integration and low costs is only half of the problem. You also have to make a product that people want, otherwise the whole enterprise is meani
by lmm 2y ago
OK but vertical integration and low costs is only half of the problem. You also have to make a product that people want, otherwise the whole enterprise is meaningless. SpaceX is selling launches every week. What is Google selling that uses all those TPUs, and to whom?
- lokar 2y agoBehavioral advertising.
- dekhn 2y agoTPUs are used internally for products and research and also sold as a service thru Google Cloud. The list of TPU customers is pretty long. But Google could the product entirely internal and still reap plenty of benefit.
- mmaunder 2y agoGemini 2 was entirely trained on Trillium, Googles 6th generation TPU. About 100,000 of them. And all inference is run on TPUs. https://venturebeat.com/ai/google-new-trillium-ai-chip-delivers-4x-speed-and-powers-gemini-2-0/ https://venturebeat.com/ai/google-new-trillium-ai-chip-deliv...
- lmm 2y agoRight. But are people paying for Gemini? Does all that vertical integration make it cheaper than its competitors? (Which is what works for SpaceX)
- nmfisher 2y agoGemini Flash is my go-to for many client projects, so there's at least a few people paying for it. If it fits your use case, it's easily the best value for money, and often makes something commercially viable that wouldn't otherwise be. Sample size of 1, obviously, so YMMV. I also pay for Claude Pro for personal coding use, so I'm aware that Flash isn't exactly a drop-in replacement for a more powerful model. From my limited testing, though, Pro 2.0 is almost indistinguishable from 3.5 Sonnet.
- Reubend 2y agoEven if the LLM hype dies, and nobody at all wants to rent TPUs from GCP, then Google can use the TPUs to train and run large advertising models and improve the quality of their search. They themselves are a big enough customer to make this worth it. Any business from GCP is just icing on the cake. Keep in mind that TPUs can train non-LLM models too.
- m_mueller 2y agoAll the ad tech in the world won’t matter if people have stopped using the medium those ads are displayed on top of by then. I think the way people use the web is about to change drastically.
- fredski42 2y agoVery much this. I think the reason Google products are more and more infested with ads is to keep up revenue against people moving to better alternatives.
- jeffbee 2y agoGoogle has been charging people actual money to access features running on TPUs for years. I helped launch TPU inference features for Gmail in 2015. There may have been earlier systems running on TPU that I wasn't aware of.
- griomnib 2y agoTargeted ads use a lot of behavioral models. Google sells ads.
- kelvinjps10 2y agoJust killing the competition is enough with their integrated products?, like google search with ai features,(perplexity.ai) Ai on android now gemini replacing google voice (chat gpt and others).
- creato 2y agoMany of those launches are sold to itself (starlink), just like google uses a lot of its TPU capacity for its own purposes.