2 ms·
That's arguable. It's entirely nontrivial to spin up a custom TPU and the ecosystem around it, and nvidia is fairly good at supporting the entire end-to-end pi
by dekhn 5y ago
That's arguable. It's entirely nontrivial to spin up a custom TPU and the ecosystem around it, and nvidia is fairly good at supporting the entire end-to-end picture (hardware, software, interconnect, higher level libs, etc). Easier to just spend $$$ on a first-rate system built by skilled integrators and replace it every few years.
TPUs are also just catching up on sparse workloads.