3 ms·
What kind of maths is required? I am not a practitioner but I try to stay up to date. I read ML papers, and it seems like they only require pretty basic maths (
by sakex 4y ago
What kind of maths is required? I am not a practitioner but I try to stay up to date. I read ML papers, and it seems like they only require pretty basic maths (as in High School level.) Linear algebra, calculus, and stochastic calculus. It seems to me you can go a long way with just understanding the chain rule and dot products.
I am trying to build my own Language Model using Pytorch and it is much easier than a lot of the stuff I've had to do as a traditional SWE over the years. My understanding is that the difficulty comes from training massive models that cannot fit on a single GPU efficiently, so more of a software problem than a maths problem.
Am I suffering from the Dunning-Kruger effect ? Or is the genius of the field in the combination of this limited set of techniques ?