2 ms·
Direct link to an implementation on GitHub: https://github.com/nebuly-ai/nebullvm/tree/main/apps/accelerate/forward_forward https://github.com/nebuly-ai/nebullv
by mdp2021 4y ago
Direct link to an implementation on GitHub: https://github.com/nebuly-ai/nebullvm/tree/main/apps/accelerate/forward_forward https://github.com/nebuly-ai/nebullvm/tree/main/apps/acceler...
--
The divulgational title is almost an understatement: the Forward-Forward algorithm is an alternative to backpropagation.
Edit: sorry, the previous formulation of the above in this post, relative to the advantages, was due to a misreading. Hinton writes:
> The Forward-Forward algorithm (FF) is comparable in speed to backpropagation but has the advantage that it can be used when the precise details of the forward computation are unknown. It also has the advantage that it can learn while pipelining sequential data through a neural network without ever storing the neural activities or stopping to propagate error derivatives....The two areas in which the forward-forward algorithm may be superior to backpropagation are as a model of learning in cortex and as a way of making use of very low-power analog hardware without resorting to reinforcement learning
- deleted 4y ago[deleted]