4 ms·
The TPU obviously uses a systolic array: https://jax-ml.github.io/scaling-book/tpus/ https://jax-ml.github.io/scaling-book/tpus/
by FL33TW00D 2y ago
The TPU obviously uses a systolic array:
https://jax-ml.github.io/scaling-book/tpus/ https://jax-ml.github.io/scaling-book/tpus/
- almostgotcaught 2y agoFair enough - my understanding was they moved away from systolic arrays. I stand corrected. I will also say it is well-known they're basically impossible to program/build a compiler for.
- FL33TW00D 2y agoThis is why Google has 500 people working on the TPU compiler team.