Yes, obviously...? A piece of paper holds more than a single word as well. That piece of paper is the context in this analogy. It still generates one token at

Yes, obviously...? A piece of paper holds more than a single word as well. That piece of paper is the context in this analogy. It still generates one token at a time and can't backtrack afterwards.