As someone else said, when using einops, einsum, named tensors (named dimensions), it doesn't really matter. For most software frameworks, there is anyway not

As someone else said, when using einops, einsum, named tensors (named dimensions), it doesn't really matter. For most software frameworks, there is anyway not a diff between column vector vs row vector, it's just shape [dim] in any case, but it becomes relevant how you do matmul etc. with some other matrix [dim1, dim2] or some other tensor [dim1, dim2, dim3].