4 ms·

It's interesting that Anthropic also has gotten quite a large investment from Google, and uses Google for its training. I wonder if this is a good move from th

It's interesting that Anthropic also has gotten quite a large investment from Google, and uses Google for its training. I wonder if this is a good move from the standpoint of playing the two major cloud providers off each other. Here it says they're going to use Amazon's chips for training and inference, but...Amazon doesn't have its own chips yet??? So I wonder how these deals are structured? Does amazon have to supply a custom AI chip that beats some benchmark? Would be pretty great if that part of the deal to use their chips involved beating TPUs, and if somehow Google's TPUs continue improving, they don't have to switch. All in all, I'm very impressed with Anthropic as a company. I think they're the new OpenAI.

Bellyache5 3y ago
No idea if it's any good or not, but Amazon has their own "Inferentia" chips. https://aws.amazon.com/machine-learning/inferentia/ https://aws.amazon.com/machine-learning/inferentia/
deleted 3y ago
[deleted]
jedberg 3y ago
> Here it says they're going to use Amazon's chips for training and inference, but...Amazon doesn't have its own chips yet??? Amazon has had its own chips for years. They bought a company called Annapurna Labs in 2015, who made the chips[0]. https://aws.amazon.com/machine-learning/inferentia/ https://aws.amazon.com/machine-learning/inferentia/ https://aws.amazon.com/machine-learning/trainium/ https://aws.amazon.com/machine-learning/trainium/ [0] https://en.wikipedia.org/wiki/Annapurna_Labs https://en.wikipedia.org/wiki/Annapurna_Labs
- deleted 3y ago
  [deleted]
- VirusNewbie 3y ago
  Ah, thanks for the correction, I wasn't aware. I wonder how it compares to TPU and I really would love to know if the decision to switch is made by the engineers or the finance folks simply due to the credits.
  - jedberg 3y ago
    I'm not sure how it compares to TPU, but I know that both TPU and Trainium lack to software support that Nvidia has, which makes them much less popular and harder to work with.
    - VirusNewbie 3y ago
      Yeah, the difference I guess would be that JAX and TF both support TPU "out of the box". I'm guessing that's not the case for Tranium, which is maybe why they're not training with them yet, but agreed to in the future.

Bellyache5 3y ago

No idea if it's any good or not, but Amazon has their own "Inferentia" chips. https://aws.amazon.com/machine-learning/inferentia/ https://aws.amazon.com/machine-learning/inferentia/

deleted 3y ago

[deleted]

jedberg 3y ago

> Here it says they're going to use Amazon's chips for training and inference, but...Amazon doesn't have its own chips yet??? Amazon has had its own chips for years. They bought a company called Annapurna Labs in 2015, who made the chips[0]. https://aws.amazon.com/machine-learning/inferentia/ https://aws.amazon.com/machine-learning/inferentia/ https://aws.amazon.com/machine-learning/trainium/ https://aws.amazon.com/machine-learning/trainium/ [0] https://en.wikipedia.org/wiki/Annapurna_Labs https://en.wikipedia.org/wiki/Annapurna_Labs

deleted 3y ago
[deleted]
VirusNewbie 3y ago
Ah, thanks for the correction, I wasn't aware. I wonder how it compares to TPU and I really would love to know if the decision to switch is made by the engineers or the finance folks simply due to the credits.
- jedberg 3y ago
  I'm not sure how it compares to TPU, but I know that both TPU and Trainium lack to software support that Nvidia has, which makes them much less popular and harder to work with.
  - VirusNewbie 3y ago
    Yeah, the difference I guess would be that JAX and TF both support TPU "out of the box". I'm guessing that's not the case for Tranium, which is maybe why they're not training with them yet, but agreed to in the future.