There's the token limit-- the maximum number of tokens to respond. There's also the token context: how many words into the "past" it considers when formulating

There's the token limit-- the maximum number of tokens to respond. There's also the token context: how many words into the "past" it considers when formulating the next word. They're different things. You can generate very, very long responses with a model with a short context window; it just will have amnesia about what it said earlier-- though OpenAI often seems to restrict you / prevent you from having context scroll off in this way.