3 ms·
Here, "Grokking" seems to be defined as a quick shift in the degree of generalization of a model. I'm not sure this is in any way an interesting phenomena. The
by joe_the_user 3y ago
Here, "Grokking" seems to be defined as a quick shift in the degree of generalization of a model. I'm not sure this is in any way an interesting phenomena. The original paper doesn't seem to be referenced [1] and I'd speculate the interest in the "alignment" community.
[1] https://scholar.google.com/scholar?cites=4466239674951044045&as_sdt=2005&sciodt=0,5&hl=en https://scholar.google.com/scholar?cites=4466239674951044045...