3 ms·
Thanks for the response, I appreciate it. I do notice variation in quality throughout the day. I use it primarily for searching documentation since it’s faster
by wasmainiac 8mo ago
Thanks for the response, I appreciate it. I do notice variation in quality throughout the day. I use it primarily for searching documentation since it’s faster than google in most case, often it is on point, but also it seems off at times, inaccurate or shallow maybe. In some cases I just end the session.
- nl 8mo agoUsually I find this kind of variation is due to context management. Accuracy can decreases at large context sizes. OpenAI's compaction handles this better than anyone else, but it's still an issue. If you are seeing this kind of thing start a new chat and re-run the same query. You'll usually see an improvement.
- repeekad 8mo agoThis is called context rot
- charcircuit 8mo agoI thought context rot was only for long distance queries.
- wasmainiac 8mo agoI don't think so. I am aware that large contexts impacts performance. In long chats an old topic will someone be brought up in new responses, and the direction of the mode is not as focused. Regardless I tend to use new chats often.