> Language Model that puts one token after the other, The interesting thing about the one-token-at-a-time process in OpenAI transformer LLMs is how the Attenti

> Language Model that puts one token after the other, The interesting thing about the one-token-at-a-time process in OpenAI transformer LLMs is how the Attention Mechanism is executing ~1600 processes in parallel over the entire context window for each new token generated. So it is dynamically re-evaluating the entire context (including the rules of the game) in relation to the next token at each step.