2 ms·
I loved the synthetic gradients idea when it came out, but the deafening silence in the following months has been a letdown. I was hoping synthetic gradients wo
by visarga 10y ago
I loved the synthetic gradients idea when it came out, but the deafening silence in the following months has been a letdown. I was hoping synthetic gradients would be great for parallelizing models on multiple GPUs or improving RNNs.
- williamtrask 10y agoyou know what's funny though...i don't think it's that hard to implement... best i can tell, every framework already has what it needs. there's just no boilerplate code for people to start with yet.