3 ms·
No, if that were the case, then Google would have made GPUs + NN cores vs TPUs. There's far more microarchitectural complexity in GPUs that actually isn't effi
by jasonwatkinspdx 8mo ago
No, if that were the case, then Google would have made GPUs + NN cores vs TPUs.
There's far more microarchitectural complexity in GPUs that actually isn't efficient for NN structures.
"Systolic array" actually means something more specific than "repeated structures on a die."
Again, I'd suggest referencing the various HotChips presentations. It's a really interesting topic area. Or the original TPU v1 paper for the basics.
- 0-_-0 8mo agoWhy would Google need graphics functionality to train neural networks?