DeepMind has a thing called synthetic gradients: https://www.deepmind.com/blog/decoupled-neural-interfaces-using-synthetic-gradients#:~:text=The%20synthetic%20g

DeepMind has a thing called synthetic gradients: https://www.deepmind.com/blog/decoupled-neural-interfaces-using-synthetic-gradients#:~:text=The%20synthetic%20gradient%20model%20takes,with%20respect%20to%20the%20activations https://www.deepmind.com/blog/decoupled-neural-interfaces-us....