2 ms·
> Here it says they're going to use Amazon's chips for training and inference, but...Amazon doesn't have its own chips yet??? Amazon has had its own chips for
by jedberg 3y ago
> Here it says they're going to use Amazon's chips for training and inference, but...Amazon doesn't have its own chips yet???
Amazon has had its own chips for years. They bought a company called Annapurna Labs in 2015, who made the chips[0].
https://aws.amazon.com/machine-learning/inferentia/ https://aws.amazon.com/machine-learning/inferentia/
https://aws.amazon.com/machine-learning/trainium/ https://aws.amazon.com/machine-learning/trainium/
[0] https://en.wikipedia.org/wiki/Annapurna_Labs https://en.wikipedia.org/wiki/Annapurna_Labs
- deleted 3y ago[deleted]
- VirusNewbie 3y agoAh, thanks for the correction, I wasn't aware. I wonder how it compares to TPU and I really would love to know if the decision to switch is made by the engineers or the finance folks simply due to the credits.
- jedberg 3y agoI'm not sure how it compares to TPU, but I know that both TPU and Trainium lack to software support that Nvidia has, which makes them much less popular and harder to work with.
- VirusNewbie 3y agoYeah, the difference I guess would be that JAX and TF both support TPU "out of the box". I'm guessing that's not the case for Tranium, which is maybe why they're not training with them yet, but agreed to in the future.