4 ms·
Does that mean it’s 64x as fast for 16-bit floating point vs 64-bit for a rank 3 tensor?
by stochastic_monk 8y ago
Does that mean it’s 64x as fast for 16-bit floating point vs 64-bit for a rank 3 tensor?
- dnautics 8y agoassuming 1) memory bandwidth is the bottleneck and 2) you can keep the tensor values in cache or registers. I think that GPUs are still vector processing engines, so they should scale with 4x... But assuming google architected the TPU correctly, it should be 16x as fast (I think the architecture is actually that of a rank-2 tensor).