3 ms·
OpenAI has a `max_tokens` setting. For the /chat/completions api, it defaults to the maximum for a desired model, but for the /completions api, it defaults to 1
by kevlened 2y ago
OpenAI has a `max_tokens` setting. For the /chat/completions api, it defaults to the maximum for a desired model, but for the /completions api, it defaults to 16.
https://platform.openai.com/docs/api-reference/chat/create#chat-create-max_tokens https://platform.openai.com/docs/api-reference/chat/create#c...
- paradite 2y agoOps. Not sure how I missed that.