3 ms·
Some people use backpropagation and gradient decent interchangeably. It's really confusing though
by savant_penguin 6y ago
Some people use backpropagation and gradient decent interchangeably. It's really confusing though
- jhrmnn 6y agoI wouldn’t say it’s confusing—it’s wrong and suggests at the least sloppiness in terminology
- ethbr0 6y ago> sloppiness in terminology venturebeat.com Not the worst, but we're not talking Nature or Spectrum here.
- option 6y agoof course it is wrong. One nice thing about math is that thing are defined precisely and back propagation and, say, SGD or Adam are different things
- dnautics 6y agoThat's bad. There are gradient descent techniques that are feed-forward, and understand the domains where those are appropriate and the domains where backprop is appropriate is I think important, especially as you try to do things like mix machine learning techniques with other differentiable programming strategies.