3 ms·
I dont think of the 4000 tokens as its memory as such. Its more like the size of its thinking workspace
by didntreadarticl 4y ago
I dont think of the 4000 tokens as its memory as such. Its more like the size of its thinking workspace
- int_19h 4y agoIt also functions as memory in practice, though. With some complex tasks that can be broken down into steps, it often makes a big difference if you tell GPT to summarize its "understanding" of the current state as it goes through those steps - by repeating a phrase, keeping it within the token window, it effectively "remembers" something.