3 ms·
It had a context window of 8192 characters (2x as long as GPT3). It is possible they are using GPT itself to summarize the past transcript and pass that in as
by gamegoblin 4y ago
It had a context window of 8192 characters (2x as long as GPT3).
It is possible they are using GPT itself to summarize the past transcript and pass that in as context. So your “remember X” would probably get included in that summary.
That said, I have not tried to tell it to remember X and then exceeded the 8192 token contest window.
Source: https://twitter.com/goodside/status/1598882343586238464 https://twitter.com/goodside/status/1598882343586238464
- shrimpx 4y agoBtw the GPT3 codex model `code-davinci-002` has a 8k token limit, too.