Einsum is a generalization of matrix multiplications to "tensor multiplications". It can take as_strided objects as input. I don't think there exists a cuda-ac

Einsum is a generalization of matrix multiplications to "tensor multiplications". It can take as_strided objects as input. I don't think there exists a cuda-accelerated einsum, so the equivalent matmul is always faster? With cuda, it might be implemented by "exploding" the inputs to matrices, which means it can quickly run out of memory?