> grokking doesn't and will not have practical uses, imo I'm not so sure. Reasoning is the next big hurdle, and grokking and parametric memory seem very effect

> grokking doesn't and will not have practical uses, imo I'm not so sure. Reasoning is the next big hurdle, and grokking and parametric memory seem very effective here. [1] https://arxiv.org/abs/2405.15071 https://arxiv.org/abs/2405.15071