4 ms·
Trillium, the sixth generation of Google Cloud TPU
- PunchTornado 2y agoAnyone know how this compares with latest nvidia?
- VikingCoder 2y agoMmmmm.... No. But I dug up this: TPUv5e has 197 (bf16) TOPS (Tera Operations Per Second) TPU V6 is 4.7x that, so... TPU V6 is maybe 925.9 (bf16) TOPS And I think I'm comparing apples to apples when I see this; H200 BFLOAT16 Tensor Core 1,979 TFLOPS So from my napkin calculations, Nvidia is 2x the raw flops... But I didn't compare memory, bandwidth, or power efficiency... Or cost.
- boroboro4 2y agoH200 1979 TFLOPS includes sparsity, real one is twice smaller. So basically it’s on par performance to H200.
- htrp 2y agoI liked TPUV6 (as a name) way better..
- twobitshifter 2y agoWould love if these can be used outside the cloud. A new version of the Coral TPU would be nice to see.
- dekhn 2y agocoral tpu has absolutely nothing to do with the data center TPU.