3 ms·
Anyone building the largest of LLMs including Alphabet, Meta, OpenAI, Anthropic
by jmathai 2y ago
Anyone building the largest of LLMs including Alphabet, Meta, OpenAI, Anthropic
- spwa4 2y agoI think you should probably add all large cloud providers. Amazon and Microsoft should be in the list.
- azinman2 2y agoAnd we know OpenAI uses Microsoft for GPUs. My guess is Anthropic is similarly not owning their own data centers; didn’t they get a bunch of money from google? It’s probably being spent there.
- alephnerd 2y agoThey use AWS.
- VirusNewbie 2y agoNo they don’t.
- azinman2 2y agoCare to substantiate? According to Wikipedia: In September 2023, Amazon announced an investment of up to $4 billion, followed by a $2 billion commitment from Google in the following month. They probably use both. Almost certainly most of this is credits in their cloud platforms.
- qwertox 2y agoI doubt Anthropic builds their own GPU datacenter. They might buy some, but I think that Google, Meta, Microsoft and Amazon and will be the ones buying in large batches to enable companies like Anthropic (and themselves) to scale up to world wide inferencing demands, as well as generally offering the most efficient GPUs to their customers.
- jmathai 2y agoThink they're renting GPUs from the cloud providers? Very plausible. I'm not sure at which point it makes economic sense to buy the GPUs and build out the infrastructure to continually be training something like Claude.
- alephnerd 2y ago> Think they're renting GPUs from the cloud providers It's a major reason why they raised with Amazon [0] There are actually a LOT of other large companies that participated in Anthropic's round but haven't announced it publicly. [0] - https://www.aboutamazon.com/news/company-news/amazon-anthropic-ai-investment https://www.aboutamazon.com/news/company-news/amazon-anthrop...
- deleted 2y ago[deleted]
- VirusNewbie 2y agoThey train on GCP now.
- bigyikes 2y agoThey also raised with Google, interestingly. https://www.wsj.com/tech/ai/google-commits-2-billion-in-funding-to-ai-startup-anthropic-db4d4c50 https://www.wsj.com/tech/ai/google-commits-2-billion-in-fund...
- alephnerd 2y agoYep! You're right! I think they were initially using AWS though.
- danjl 2y agoOh, I would not forget governments. The NSA basically paid for Kepler with a single purchase...