3 ms·
If you're writing back propogation algorithms you need to check out "automatic differentiation" which gives it to you effectively for free. http://searchyc.com
by RiderOfGiraffes 18y ago
If you're writing back propogation algorithms you need to check out "automatic differentiation" which gives it to you effectively for free.
http://searchyc.com/%2522automatic+differentiation%2522 http://searchyc.com/%2522automatic+differentiation%2522
- almost 18y agoThanks, I saw the article on that a few days ago here and it looks really interesting. Is it really right that I could just use that to automatically recreate the entire backprop algorithm? Is it likely to be reasonable in its performance?
- RiderOfGiraffes 18y agoPass. I've read the papers, I've seen the demo, but I haven't implemented it myself. I also read it here, but I've seen it before. It looks like it should work, but YMMV. As always, you might need to spend some time understanding what it does and how it works before relying on it.