5 ms·
Really important update that was not mentioned: gpt-4o-2024-08-06 has 16,384 tokens output limit instead of 4,096 tokens. https://platform.openai.com/docs/mod
by paradite 2y ago
Really important update that was not mentioned:
gpt-4o-2024-08-06 has 16,384 tokens output limit instead of 4,096 tokens.
https://platform.openai.com/docs/models/gpt-4o https://platform.openai.com/docs/models/gpt-4o
We don't need the GPT-4o Long Output anymore.
- OutOfHere 2y agoBut is this also the default or just the max? Is the default 4k or 16k? Also, the question of the default value applies both at the server level and at the SDK level.
- paradite 2y agoUnlike Anthropic, OpenAI models don't have a `max_tokens` setting for API calls, so I assume the max token output limit is automatically applied to API calls. Otherwise the max token output limit stated on the models page would be meaningless.
- kevlened 2y agoOpenAI has a `max_tokens` setting. For the /chat/completions api, it defaults to the maximum for a desired model, but for the /completions api, it defaults to 16. https://platform.openai.com/docs/api-reference/chat/create#chat-create-max_tokens https://platform.openai.com/docs/api-reference/chat/create#c...
- paradite 2y agoOps. Not sure how I missed that.
- floam 2y agoLong Output is 64K though.