10 ms·
intraday NN is irrelevant because NN are prone to overlearning I call bullshit. A lot of the most successful applications in machine learning are modeled using
by bravura 17y ago
intraday NN is irrelevant because NN are prone to overlearning
I call bullshit. A lot of the most successful applications in machine learning are modeled using neural networks.
To regularize a neural network, you use standard machinery that controls the capacity of the machine. The scale of the weights cannot be too large (this is a famous result from IIRC Haussler in 1992) so penalize the weights using an l2 (Gaussian) prior. This reduces the model complexity and the potential for overfitting.