3 ms·
Ah, thanks for the correction, I wasn't aware. I wonder how it compares to TPU and I really would love to know if the decision to switch is made by the enginee
by VirusNewbie 3y ago
Ah, thanks for the correction, I wasn't aware.
I wonder how it compares to TPU and I really would love to know if the decision to switch is made by the engineers or the finance folks simply due to the credits.
- jedberg 3y agoI'm not sure how it compares to TPU, but I know that both TPU and Trainium lack to software support that Nvidia has, which makes them much less popular and harder to work with.
- VirusNewbie 3y agoYeah, the difference I guess would be that JAX and TF both support TPU "out of the box". I'm guessing that's not the case for Tranium, which is maybe why they're not training with them yet, but agreed to in the future.