4 ms·
Okay, I mean I feel like they’re not that mysterious. Like, there are probably only five or six candidates.
by rsynnott 2y ago
Okay, I mean I feel like they’re not that mysterious. Like, there are probably only five or six candidates.
- kergonath 2y agoAnd regardless of who the 4 are, the two others in that list of six candidates are most likely not too far behind.
- gpm 2y agoThe most interesting thing to discover would be if one of them is that far behind, because they're succeeding on their own/someone not-Nvidia's silicon. The public in-house projects that I'm aware of (but as far as I know haven't fully replaced demand for Nvidia GPUs) include: - Google's "TPU" (in production, publicly rentable) - Amazon/AWS's "Trainium" (in production, publicly rentable) - Meta's "MTIA" (in production) - Microsoft's "Maia 100" (I'm unclear on their status) - Tesla's "D1" (I'm unclear on their status)
- HarHarVeryFunny 2y agoxAI 100K H100 cluster would be ~$2B Is this trailing year NVIDIA sales, or order book ?
- jsnell 2y agoThe numbers in the article? They're neither. They're the revenue for just Q2, not the full trailing year.
- jsheard 2y agoAre these distinct architectures, or is it an ARM situation where nearly everyone is gluing the same IP cores together in slightly different configurations?
- taktoa 2y agoDefinitely not an ARM situation.
- zaphar 2y agoI'm not sure about all of them but Google's TPU is custom to them and not shared architecture.
- pclmulqdq 2y agoThey are distinct architectures, but mostly do the same thing. Pretty much all of them have a few small control cores that run matrix multiply and vector reduction units. The instruction set on all of them is different, but the broad strokes of the architecture are the same.
- rajman187 2y agoMTIA will be for inference initially. Another to add to the list is wafer maker Cerebras https://www.forbes.com/sites/craigsmith/2024/08/27/cerebras-speeds-ai-by-putting-entire-foundation-model-on-its-giant-chip/ https://www.forbes.com/sites/craigsmith/2024/08/27/cerebras-...
- solidasparagus 2y agoIt's not just the hardware, it's the software stack too and my understanding is that they aren't very good. Even TPUs aren't great if you aren't either (1) doing something extremely standard and a little bit old (e.g. not forefront of research and the stack has already been optimized for your model) or (2) in Google with access to the people who build the stack. Maybe it is working for Meta or Tesla where things can be vertically integrated, but for the public clouds, they have to buy NVIDIA for their customers.
- deleted 2y ago[deleted]
- bradleyjg 2y agoDoes TSM have the capacity to scale up anything new right now?
- ninetyninenine 2y agoLet's name them, and why?
- jmathai 2y agoAnyone building the largest of LLMs including Alphabet, Meta, OpenAI, Anthropic
- spwa4 2y agoI think you should probably add all large cloud providers. Amazon and Microsoft should be in the list.
- azinman2 2y agoAnd we know OpenAI uses Microsoft for GPUs. My guess is Anthropic is similarly not owning their own data centers; didn’t they get a bunch of money from google? It’s probably being spent there.
- alephnerd 2y agoThey use AWS.
- VirusNewbie 2y agoNo they don’t.
- azinman2 2y agoCare to substantiate? According to Wikipedia: In September 2023, Amazon announced an investment of up to $4 billion, followed by a $2 billion commitment from Google in the following month. They probably use both. Almost certainly most of this is credits in their cloud platforms.
- qwertox 2y ago
- 7thpower 2y agoCompanies like Coreweave who lease accelerators may make this analysis less straight forward than it appears.
- jeffbee 2y agoEven less straightforward since Nvidia funds Coreweave.
- deleted 2y ago[deleted]
- nosefurhairdo 2y ago> Although the names of the mystery AI whales are not known, they are likely to include Amazon, Meta, Microsoft, Alphabet, OpenAI, or Tesla.
- terafo 2y agoWhy mention Microsoft twice?
- mensetmanusman 2y agoThe departments aren’t talking, so they accidentally made two orders.
- fnordpiglet 2y agoI’d note Microsoft needs OpenAI a hell of a lot more than OpenAI needs Microsoft. I’d actually pivot that to be why mention OpenAI twice.
- FridgeSeal 2y agoOpenAI doesn’t operate without the enormous amounts of funding MS gives it.
- adwi 2y agoI think a lot of institutions and people would love the chance to give them money.
- noirbot 2y agoBut how many of them have hot data centers to offer? Google is a direct competitor, so Oracle or Amazon are kinda the only other two big options to offer them what MS is right now. If MS drops OpenAI, it's not like they can just seamlessly pivot to running their own data centers with no downtime, even with pretty high investment.