They've presented a hypothesis warranting further study. Here is an article where a model's learned ability to carry out modular addition is recovered. https:/

They've presented a hypothesis warranting further study. Here is an article where a model's learned ability to carry out modular addition is recovered. https://arxiv.org/abs/2301.05217 https://arxiv.org/abs/2301.05217 As you can see, the jury's still out.