3 ms·
This kind of just sounds like junk that will clog up the context window I'll have try it out though to know for sure
by drcode 3y ago
This kind of just sounds like junk that will clog up the context window
I'll have try it out though to know for sure
- Prosammer 3y agoI've been finding with these large context windows that context window length is no longer the bottleneck for me — the LLM will start to hallucinate / fail to find the stuff I want from the text long before I hit the context window limit.
- drcode 3y agoYeah, there is basically a soft limit now where it just is less effective as the context gets larger
- hobofan 3y agoI'm assuming that they have implemented it via a MemGPT-like approach, which doesn't clog the context window. The main pre-requisite for doing that is having good function calling, where OpenAI currently is significantly in the lead.