3 ms·
The large context is the reason its hallucinating and gpt would likely have the same problem. You can see this effect even on gpt-3.5-turbo-16k. Performance and
by cjonas 3y ago
The large context is the reason its hallucinating and gpt would likely have the same problem. You can see this effect even on gpt-3.5-turbo-16k. Performance and accuracy are directly correlated with context size
- danielbln 3y agoThat's just GPT3.5 having a pretty spotty attention. This becomes much less of a problem if you use gpt-4-32k.