3 ms·
Its context window is quite large -- 8192 tokens, where a token is about ~4 characters. But it's quite possible they are using GPT itself to summarize the older
by gamegoblin 4y ago
Its context window is quite large -- 8192 tokens, where a token is about ~4 characters. But it's quite possible they are using GPT itself to summarize the older parts of the conversation so they can fit more in by only keeping the important bits.
- jb_s 4y agoI was thinking something like that, bearing in mind that humans can't remember every single detail about a conversation either.