3 ms·
FTA: > One pod of TPU 8t is 121 ExaFlops; or 121,000 PetaFlops. Meanwhile, the compute capacity of the top 10 supercomputers in the entire world is 11,487 Pet
by mlmonkey 6mo ago
FTA:
> One pod of TPU 8t is 121 ExaFlops; or 121,000 PetaFlops.
Meanwhile, the compute capacity of the top 10 supercomputers in the entire world is 11,487 Petaflops.[1]
I know, I know, not the same flops, yada yada, but still. Just 1 pod alone is quite a beast.
Edit:
[1] https://top500.org/lists/top500/2025/11/ https://top500.org/lists/top500/2025/11/
- dist-epoch 6mo agoNot only not the same size, 4-bit flops versus 64-bit flops, but not the same programmability either. the TPUs can do just matrix-multiplications and some supporting math. Otherwise bitcoin mining rigs dwarf everything, if you just want to count raw operations per second.
- stabbles 6mo agoOther than TPUs they're also planning for 960,000 Rubin GPUs [1] which can do 33 teraflops fp64 each, so over 30 classical exaflops, and with emulation it could be more than 100 exaflops. [1] https://blogs.nvidia.com/blog/google-cloud-agentic-physical-ai-factories/ https://blogs.nvidia.com/blog/google-cloud-agentic-physical-...