3 ms·

I wonder if semi-reliable RAM could be made to work for training. After all gradient descent already works in a stochastic environment, so maybe the noise from

by krackers 10mo ago

I wonder if semi-reliable RAM could be made to work for training. After all gradient descent already works in a stochastic environment, so maybe the noise from a few flipped bits doesn't matter too much.

sznio 10mo ago
Also, depends on the nature of the error. If only a small memory range is affected, you could patch the kernel to avoid it.
- viraptor 10mo ago
  No need for patching you can disable specific ranges on Linux using the memmap kernel parameter. It's often used for that purpose.