5 ms·
I started playing around with NN-s recently and this looked like a good tutorial until the partial derivatives :) It would have been so much better to turn a co
by kowdermeister 8y ago
I started playing around with NN-s recently and this looked like a good tutorial until the partial derivatives :) It would have been so much better to turn a complex math concept like that to code in smaller chunks because it's hard to extract from the full sample which part refers to which equation.
Also, the bias is not explained at all.
- Why is it there?
- What does it do?
- What value should it have?
- dragandj 8y agoI currently publish a series of detailed articles that cover exactly that. https://dragan.rocks/articles/19/Deep-Learning-in-Clojure-From-Scratch-to-GPU-0-Why-Bother https://dragan.rocks/articles/19/Deep-Learning-in-Clojure-Fr...
- xeRTRex 8y agoAgreed, it is a little confusing. What makes it even more confusing is bias can be introduced as a regularization technique (to address overfitting) and these are not the same thing. Bias in this context can be simply interpreted as analogous to the intercept in y = mx + b. Kind of like the baseline when no additional information is given.
- applecrazy 8y agoPartial derivatives are basically how much a multivariate function changes based on a tiny change in a single variable. The actual math is irrelevant.