Because 4x4 Matrixes are a linear transformation of 3 dimensional space. Deep Learning chose TPUs / Tensors because GPUs (and other computers) are faster at ma

Because 4x4 Matrixes are a linear transformation of 3 dimensional space. Deep Learning chose TPUs / Tensors because GPUs (and other computers) are faster at matrix multiplication than any other operation. Many many other representations of neural networks have existed over the decades, its the matrix-based "Tensor" that performed the best and took off.