Related: an independent reverse engineering of a network that "grokked" modular addition: https://www.alignmentforum.org/posts/N6WM6hs7RQMKDhYjB/a-mechanistic-

Related: an independent reverse engineering of a network that "grokked" modular addition: https://www.alignmentforum.org/posts/N6WM6hs7RQMKDhYjB/a-mechanistic-interpretability-analysis-of-grokking https://www.alignmentforum.org/posts/N6WM6hs7RQMKDhYjB/a-mec... One interesting thing is that this network similarly does addition using a Fourier transform.