5 ms·
Is there released documentation on the instruction set of the Google Cloud TPU?
by protomyth 9y ago
Is there released documentation on the instruction set of the Google Cloud TPU?
- pjscott 9y agoThey list the main ones on pages 3-4 of this paper: https://drive.google.com/file/d/0Bx4hafXDDq2EMzRNcy1vSUxtcEk/view https://drive.google.com/file/d/0Bx4hafXDDq2EMzRNcy1vSUxtcEk... It's mainly moving memory around, matrix multiplication, convolution, and applying activation functions (sigmoid, tanh, relu, etc.). Very simple, high-level stuff. This has the handy side-effect of making timing very predictable, which makes the latency a lot more deterministic.