4 ms·
If it has to re-run the entire history every time you interact with it it will quickly slow to non-functionality in days.
by causality0 4y ago
If it has to re-run the entire history every time you interact with it it will quickly slow to non-functionality in days.
- grogenaut 4y agothat's not what happens... basically it is using a ring buffer for the history. It only runs apparently (from another post today) 4k for chatgpt4 right now with 32kb tokens coming in beta. everyotype of memory tho maybe not as limited as this.ne I think has this This is why you see it start getting wierd after a bit, it loses the history and you've basically started a new different conversation. However