Aside but I find it really interesting how looking at the layers "approach" the answer at a specific token position like this feels a lot like an iterative opti

Aside but I find it really interesting how looking at the layers "approach" the answer at a specific token position like this feels a lot like an iterative optimizer taking steps to converge on a solution.