2 ms·
"Lessons from the Real World" and "The Limits of Resilience" discussed this.
by rglover 1y ago
"Lessons from the Real World" and "The Limits of Resilience" discussed this.
- cma 1y agoNot quite, that seems to be about quantizing and dropping out after training, not random dropout throughout training. But apparently that isn't done much any more and has been partly superseded with things like weight decay.