2 ms·

I would argue ECC is completely pointless during neural network inference, the amount of change a single bit flip, even a sign change, is likely to generate is

I would argue ECC is completely pointless during neural network inference, the amount of change a single bit flip, even a sign change, is likely to generate is minimal.

vomjom 9y ago
An exponent bit flip, especially at later layers, would completely break inference.
- puzzle 9y ago
  I'd be concerned about code, too. It's not unheard of for a single bit flip to make petabytes go away (true story).