2 ms·
The question is not how many prior messages there were in the conversation. That's irrelevant for context window purposes. The question is how many tokens there
by kaelinl 3y ago
The question is not how many prior messages there were in the conversation. That's irrelevant for context window purposes. The question is how many tokens there are between the prompt and the point where the reply breaks down.