2 ms·
What matters for TPUs today is whether the problem is sparse. TPUs are good at dense matrix multiplication (btw, the 128x128 is just the unit size, it still wo
by dekhn 4y ago
What matters for TPUs today is whether the problem is sparse. TPUs are good at dense matrix multiplication (btw, the 128x128 is just the unit size, it still works with larger systems through the obvious composition of multiplications) with a modest amount of ALU and vector work and lots and lots of "tensor" (multidimensional array). And they are almost entirely 32-bit floats, not 64-bit.
So far TPUs have not really proved their worth for general purpose simulations across a wide range of fields. They weren't built for that, and we have other systems that can run the workloads faster, although it's unclear what wouuld happen if you took a really great team and had them work on a hard simulation problem (for example- my previous area was molecular dynamics, and TPUs can do great work on n-body simulations, but not so great on other parts of the force field.
If you have sparse mixed problems then CPUs are still the most cost effective. If you have dense matrix problems GPUs are the most cost effective.
If you have problems that don't fit on other systems and you have a good team to optimize to the hardware, TPUs are an option and could be cost effective in principle.