4 ms·
I suggest you take a look at Micrograd inplementation and watch video tutorial about it from Karpathy. Also „Python Deep Learning” book is quite good. In short
by machiaweliczny 3y ago
I suggest you take a look at Micrograd inplementation and watch video tutorial about it from Karpathy. Also „Python Deep Learning” book is quite good.
In short you need to understand: vector, linear combination, cross product, partial derivative, chain rule and finding global minimum. If you have basics of linear algebra it’s easy to grok this video.
https://youtu.be/VMj-3S1tku0?si=6r9XRXofN6SOPkpl https://youtu.be/VMj-3S1tku0?si=6r9XRXofN6SOPkpl
- hellojebus 3y agoI second the Micrograd implementation vid, had to pause several times to look up some concepts.. but so far the best resource I've found in regards to gradients work in neural networks