3 ms·
I've been finding with these large context windows that context window length is no longer the bottleneck for me — the LLM will start to hallucinate / fail to f
by Prosammer 3y ago
I've been finding with these large context windows that context window length is no longer the bottleneck for me — the LLM will start to hallucinate / fail to find the stuff I want from the text long before I hit the context window limit.
- drcode 3y agoYeah, there is basically a soft limit now where it just is less effective as the context gets larger