Fits with my first intuitive guess: it’s implicit regularization (that works as you describe). Would be interesting to try some explicit regularization. But un

Fits with my first intuitive guess: it’s implicit regularization (that works as you describe). Would be interesting to try some explicit regularization. But unfortunately you need a million bucks to an experiment on LLMs. :/