4 ms·
That looks interesting, do you know what paper talks about the connection between MDL, regret, and weight decay?
by joaogui1 3y ago
That looks interesting, do you know what paper talks about the connection between MDL, regret, and weight decay?
- tbalsam 3y agoI would start with Shannon's information theory and the Wikipedia page on L2/the MDL as a decent starting point. For the first, there are a few good papers that simplify the concepts even further.
- joaogui1 3y agoSorry, I know what MDL and L2 regularization are, I would like the paper that connects them in the way you mentioned