33 ms·

Let's name them, and why?

• jmathai 2y ago
  Anyone building the largest of LLMs including Alphabet, Meta, OpenAI, Anthropic
  • spwa4 2y ago
    I think you should probably add all large cloud providers. Amazon and Microsoft should be in the list.
    • azinman2 2y ago
      And we know OpenAI uses Microsoft for GPUs. My guess is Anthropic is similarly not owning their own data centers; didn’t they get a bunch of money from google? It’s probably being spent there.
      • alephnerd 2y ago
        They use AWS.
        • VirusNewbie 2y ago
          No they don’t.
          • azinman2 2y ago
            Care to substantiate? According to Wikipedia: In September 2023, Amazon announced an investment of up to $4 billion, followed by a $2 billion commitment from Google in the following month. They probably use both. Almost certainly most of this is credits in their cloud platforms.
  • qwertox 2y ago
    I doubt Anthropic builds their own GPU datacenter. They might buy some, but I think that Google, Meta, Microsoft and Amazon and will be the ones buying in large batches to enable companies like Anthropic (and themselves) to scale up to world wide inferencing demands, as well as generally offering the most efficient GPUs to their customers.
    • jmathai 2y ago
      Think they're renting GPUs from the cloud providers? Very plausible. I'm not sure at which point it makes economic sense to buy the GPUs and build out the infrastructure to continually be training something like Claude.
      • alephnerd 2y ago
        > Think they're renting GPUs from the cloud providers It's a major reason why they raised with Amazon [0] There are actually a LOT of other large companies that participated in Anthropic's round but haven't announced it publicly. [0] - https://www.aboutamazon.com/news/company-news/amazon-anthropic-ai-investment https://www.aboutamazon.com/news/company-news/amazon-anthrop...
        • deleted 2y ago
          [deleted]
        • VirusNewbie 2y ago
          They train on GCP now.
          • bigyikes 2y ago
            They also raised with Google, interestingly. https://www.wsj.com/tech/ai/google-commits-2-billion-in-funding-to-ai-startup-anthropic-db4d4c50 https://www.wsj.com/tech/ai/google-commits-2-billion-in-fund...
          • alephnerd 2y ago
  • danjl 2y ago
    Oh, I would not forget governments. The NSA basically paid for Kepler with a single purchase...
• marcosdumay 2y ago
  I believe the GP refers to Google, Facebook, Amazon and Microsoft. And while yeah, that's probably them, I'd put a non-trivial chance of some government intelligence organization to make it into the top 3.
  • ghshephard 2y ago
    I’m guessing a massive amount is for inference for whatsapp, and the original goal was making for relevant instagram - and of course the massive Llama model training - my guess is Facebook is a relatively small component of Meta’s overall use of GPUs. Feed recommendations? (unless you were using facebook as a holder for Meta?)
    • vineyardmike 2y ago
      It’s absolutely not WhatsApp. It’s their recommendation engines. They’ve publicly stated they’re buying enough GPUs to have the spare capacity to train another “reels” sized product for when the opportunity emerges. (They absolutely use it as a holder for Meta)
  • miki123211 2y ago
    ANd possibly some less-known companies, as fronts for the Chinese.
    • alephnerd 2y ago
      > less-known companies, as fronts for the Chinese. Not at that size. That is VERY on the nose sanctions evasion. Such sanctions evasions tend to use multiple smaller parties doing purchases and then reselling.
  • alephnerd 2y ago
    > I'd put a non-trivial chance of some government intelligence organization to make it into the top 3 Most likely DoE. TLAs purchase indirectly (or use other federal agencies in the DoD as a front)
• deleted 2y ago
  [deleted]