3 ms·

I am pretty sure that parent meant DNNs love to fit noise. So you two are in strong agreement.

• p1esk 11y ago
  No, we are talking about a random electrical circuit noise in the analog NN hardware. Of course, if the noise is known and fixed, the net could learn to compensate (to a certain extent). The noise we are talking about is like when you put your finger on the chip, and raise its temperature by 10 degrees, the whole thing needs to be retrained.
  • taliesinb 11y ago
    > The noise we are talking about is like when you put your finger on the chip, and raise its temperature by 10 degrees, the whole thing needs to be retrained. What would change with temperature that would require retraining? Are you saying the output of an op could depend sensitively on temperature, or that higher temperatures would increase things like thermal or shot noise? Why would the latter require retraining?
    • p1esk 11y ago
      Current depends on threshold voltage and carrier mobility, which are temperature dependent.