3 ms·

A promising and potentially useful approach for adding additional context to your prompts. How likely is it that context size will greatly increase in the comi

A promising and potentially useful approach for adding additional context to your prompts. How likely is it that context size will greatly increase in the coming year or two? Are there fundamental limits, or could we reasonably expect greatly increased context size in the future?

addisonl 4y ago
We saw an almost 10x jump between GPT-3.5-turbo and gpt-4 (4k to 32k tokens).
- daydream 4y ago
  But are we likely to get another 10x jump with say GPT4.5, and 10x over that with GPT5? Or is context likely to stay fixed around 32k for the foreseeable future? That is the question.