30 ms·

This got me thinking: Can the backpropagation algorithm be expressed as an equation? I assume this should always be possible using functional programming.

• eternauta3k 3y ago
  Are you talking about backpropagation in neural networks? Do you mean as a differential equation? It already is a normal algebraic equation.
  • cubefox 3y ago
    Yes in neural networks. Backpropagation is probably worth more than the equation in the video. But it's an algorithm, which aren't usually expressed as equations.
    • lamontcg 3y ago
      Backpropagation is just the chain rule from basic calc. Done on a massive scale in something like an LLM. You can absolutely express it as equations.