3 ms·
There's an open source implementation of the paper in pytorch https://github.com/nebuly-ai/nebullvm/tree/main/apps/accelerate/forward_forward https://github.com
by emilecourth 4y ago
There's an open source implementation of the paper in pytorch https://github.com/nebuly-ai/nebullvm/tree/main/apps/accelerate/forward_forward https://github.com/nebuly-ai/nebullvm/tree/main/apps/acceler... by @diegofiori_
He also wrote an interesting thread on the memory usage of this algo versus backprop https://twitter.com/diegofiori_/status/1605242573311709184?s=20&t=WjJVGJ_VOFuUKpRigaLLRw https://twitter.com/diegofiori_/status/1605242573311709184?s...