4 ms·
The temptation to learn neural nets "with" a programming language as opposed to math, is probably because programming is more fun. And the reason it is more fu
by omarhaneef 7y ago
The temptation to learn neural nets "with" a programming language as opposed to math, is probably because programming is more fun.
And the reason it is more fun is because you are getting instant feedback, you fix the error and get a dopamine kick when it passed that error and so forth. All the programmers here know exactly what I mean.
The math, meanwhile, is harder because you might read description, stare at an equation. Hope that you "get" it. Then read the next statement, realize you might have misunderstood the previous one and so on. You don't get the same sense of progress, and one bit of confusion can throw you off track for a long time.
One contribution would be teach the math in an environment that is like programming. I am not sure what this would look like, but you would learn how to back propagate the derivative through the network, minimizing error at each step and forward propagate the signal. It can't just be a visualization because the student won't engage with it in the same way as a system with negative and positive feedback.
- codesushi42 7y agoThere are already countless resources that do this effectively. Overall I am not an Andrew Ng fan, but his lecture on neural network basics from deeplearning.ai gets the job done. I'm sure there are other resources that are even better. The video linked here is a pointless exercise. The speaker exclaims that learning formulas and notations isn't needed, but then she dives into an even more confusing code exercise that doesn't explain anything about what gradients are and why we use them. A total waste of time. Just explain the math.