5 ms·
PSA: GPT4 (web) token limit down to 4k
As a Plus subscriber, I asked GPT4 what is the maximum input size yesterday and today. To my big surprise, the limit went down from 8192 to 4096 tokens.
Note that this is the limit of web version at https://chat.openai.com and not the API.
Yesterday's response:
https://chat.openai.com/share/dd8f00db-1ddc-4af0-9a6a-7254e301c4b2
The input character limit for this version of GPT (GPT-4) is 8,192 tokens. Keep in mind that tokens can be parts of words, whole words, or several words, depending on the language and context.
Today:
https://chat.openai.com/share/6d2e6753-d15e-4e40-b44b-0582d33953ce
The input size for GPT (including this version, GPT-4) is 4096 tokens. This includes both the prompt and the system's response. Each token can be a word or part of a word, so the actual number of words you can input will vary, but it's usually around 1500-2000 words depending on the complexity and length of the words.
- crakenzak 3y agoInteresting, mine is still 8k token length context window. https://chat.openai.com/share/4f0c8ed5-fe6d-4488-8834-e8cc9df95b29 https://chat.openai.com/share/4f0c8ed5-fe6d-4488-8834-e8cc9d...
- 404mm 3y agoHere is mine https://chat.openai.com/share/6d2e6753-d15e-4e40-b44b-0582d33953ce https://chat.openai.com/share/6d2e6753-d15e-4e40-b44b-0582d3...
- gtirloni 3y agoThat's not really accurate data. Unless it was mentioned specifically in its latest training data, you shouldn't trust it to represent the latest state of the model. You're not asking a REST API for some accurate number coming from a database.
- philomath_mn 3y agoAgreed. I'm surprised to see people continue to make this kind of mistake. The limit may or may not have changed, but this is precisely the kind of query where I'd expect hallucinations
- tikkun 3y agoIt’s 128k tokens of input and 4096 tokens of output (gpt-4-turbo), though in chatgpt it’ll be different because it uses progressive summarization for long conversations. ChatGPT now uses gpt-4-turbo.