4 ms·
Has anyone tried using another NN as the “gradient” function? With the hope of making it less “blind?”
by eismcc 4y ago
Has anyone tried using another NN as the “gradient” function? With the hope of making it less “blind?”
- rolisz 4y agoDeepMind has a thing called synthetic gradients: https://www.deepmind.com/blog/decoupled-neural-interfaces-using-synthetic-gradients#:~:text=The%20synthetic%20gradient%20model%20takes,with%20respect%20to%20the%20activations https://www.deepmind.com/blog/decoupled-neural-interfaces-us....