> Tensors are mappings which not all matrices and vectors are. A tensor in Physics is an object that follows some rules when changing reference frame. Their ma

> Tensors are mappings which not all matrices and vectors are. A tensor in Physics is an object that follows some rules when changing reference frame. Their matrix representation is just one way of writing them. It’s the same with vectors: a list with their components is a representation of a vector, not the vector itself. We can think about it that way: the velocity of an object does not depend on the reference frame. Changing the axes does not make the object change its trajectory, but it does change the numerical values of the components of the velocity vector. > So tensors aren’t generalizations of matrices and vectors. Indeed. Tensors in ML have pretty much nothing to do with tensors in Maths or Physics. It is very unfortunate that they settled on the same name just because it sounds cool and sciency.