3 ms·
It's pretty close to the theory end of the theory-application spectrum, so it could touch on many aspects of implementation. I suggest it may inform architectur
by uoaei 3y ago
It's pretty close to the theory end of the theory-application spectrum, so it could touch on many aspects of implementation. I suggest it may inform architectural improvements and/or better justifications for gradient descent training schedules.
- quickthrower2 3y agoThanks. I think when I saw kernel my mind jumped to the conclusion that it was a GPU kernel so was expecting something a bit more software engineeringy!
- uoaei 3y agoKernel is an overloaded term and actually there's two different usages of the word in the article itself: one referring to the kernel operator[1][2] (the primary subject of the article) and another referring to the kernel of a homomorphism[3] (essentially the complement of a subspace in a coordinate system in the linear case). [1] https://en.m.wikipedia.org/wiki/Positive-definite_kernel https://en.m.wikipedia.org/wiki/Positive-definite_kernel [2] https://www.cs.toronto.edu/~duvenaud/cookbook/ https://www.cs.toronto.edu/~duvenaud/cookbook/ [3] https://en.m.wikipedia.org/wiki/Kernel_(algebra) https://en.m.wikipedia.org/wiki/Kernel_(algebra)