4 ms·
No, that's not how backprop works. There will be no discontinuity in a backpropagated gradient.
by WithinReason 11mo ago
No, that's not how backprop works. There will be no discontinuity in a backpropagated gradient.
- macleginn 11mo agoI did not say there will be a discontinuity in the gradient; I said that the modified loss function will not have a mathematically well-defined derivative because of the discontinuity in the function.
- WithinReason 11mo agoWhich is completely irrelevant to the point I was making