The feedforward nature of transformers means that it can only do a limited number of computational steps. Having it explain an algorithm is a good way to have i

The feedforward nature of transformers means that it can only do a limited number of computational steps. Having it explain an algorithm is a good way to have it use its output as a tape during inference/decoding, but even then it just fudges things and makes mistakes for largish numbers.