I suppose a derivative of serendipity is at work here. That is we accidentally find something unused and is suddenly very useful (backprop although not a perfec

I suppose a derivative of serendipity is at work here. That is we accidentally find something unused and is suddenly very useful (backprop although not a perfect example). But I think there was a paper sometime back that showed if you want to take advantage of seredipity you may want to divide your resources equally.