3 ms·
He doesn't implement matrix operations, floating point addition / multiplication either.
by charcircuit 5y ago
He doesn't implement matrix operations, floating point addition / multiplication either.
- weberer 5y agoI bet he didn't even create the universe.
- godelski 5y agoThe difference is that autograd isn't something you should already know if you're learning neural networks. Many "from scratch" tutorials implement backprop because this is a key part. I think your comment is a bit facetious and you're not acting in good faith.
- charcircuit 5y agoI could definitely see an argument that knowing gradient descent is a requisite just as much as knowing matrix multiplication. Both of these mathematical concepts are being abstracted over and are being used by the author's neutral network implementation. Now whether you consider using other people's libraries for this as being "from scratch" is up to you.
- deleted 5y ago[deleted]