I would guess max_tokens refers to the number of generated tokens, not the size of the context window. That at least is the meaning of max_tokens in the ChatGPT

I would guess max_tokens refers to the number of generated tokens, not the size of the context window. That at least is the meaning of max_tokens in the ChatGPT API. https://platform.openai.com/docs/api-reference/chat/create#chat/create-max_tokens https://platform.openai.com/docs/api-reference/chat/create#c...