3 ms·
In the case of neural network training the cost of verifying that a gradient submitted by a peer reduces the cost function should be significantly less than gen
by 0-_-0 6y ago
In the case of neural network training the cost of verifying that a gradient submitted by a peer reduces the cost function should be significantly less than generating that gradient, so you wouldn't even need to burn 2x effort to evade cheaters.
- drdeca 6y agoIs it possible to submit a falsified gradient which still reduces the cost, but less so than the actual gradient would, and such that how the network behaves is manipulated? Like, say, if one selected some of the images in the batch to use a different label for when computing the gradient, but still using the right label for most of the images in the batch?
- 0-_-0 6y agosubsequent gradient updates would probably wipe out the manipulation