3 ms·
He is not saying analog computation will "fix all problems". He is saying the computation that is happening that props up a Trump resembles an analog system whe
by k9s9 8y ago
He is not saying analog computation will "fix all problems". He is saying the computation that is happening that props up a Trump resembles an analog system where noise plays a role.
- visarga 8y agoThat fits well with neural nets, where noise plays a crucial role, from the random order of selecting examples into batches, to randomly dropping out synapses, directly injecting noise, or even starting prediction from pure noise (GANs). In RL the epsilon-greedy technique prescribes random actions from time to time, in order to better explore the environment. Noise, when used properly, makes neural nets better and more resilient.