3 ms·
But is this also the default or just the max? Is the default 4k or 16k? Also, the question of the default value applies both at the server level and at the SDK
by OutOfHere 2y ago
But is this also the default or just the max? Is the default 4k or 16k?
Also, the question of the default value applies both at the server level and at the SDK level.
- paradite 2y agoUnlike Anthropic, OpenAI models don't have a `max_tokens` setting for API calls, so I assume the max token output limit is automatically applied to API calls. Otherwise the max token output limit stated on the models page would be meaningless.
- kevlened 2y agoOpenAI has a `max_tokens` setting. For the /chat/completions api, it defaults to the maximum for a desired model, but for the /completions api, it defaults to 16. https://platform.openai.com/docs/api-reference/chat/create#chat-create-max_tokens https://platform.openai.com/docs/api-reference/chat/create#c...
- paradite 2y agoOps. Not sure how I missed that.