4 ms·
Has anyone noticed that OpenAI is cutting off submitted context in ChatGPT Pro? If I send about 60k tokens, the model can't see the question (at the bottom of
by energy123 1y ago
Has anyone noticed that OpenAI is cutting off submitted context in ChatGPT Pro?
If I send about 60k tokens, the model can't see the question (at the bottom of the text). I need to reduce it to 50k.
If I send two prompts with 40k tokens, the model can't see the beginning of the first prompt.
This seems quite unethical given they advertise 128k context, and I doubt it's an accident (since it runs in the direction of cost savings).