It's just a matter of mirroring the kernel, and since the kernels are learned I don't really see the big deal. I guess the usage of the term convolution comes f

It's just a matter of mirroring the kernel, and since the kernels are learned I don't really see the big deal. I guess the usage of the term convolution comes from image processing and other DSP where it used to be actual convolution, and now the operation is basically the same even if you might not even care about the actual values in each kernel.