3 ms·
Ask HN: Is a slow ChatGPT response an indication of difficulty in some sense?
Maybe it requires data that is not cached? Or maybe there is more computation involved?
- mjtechguy 2y agoLLMs don’t currently “think”. So I assume a slow response is just a system load issue.
- mouse_ 2y agoIt could be system load, or it could be Microsoft trying to manipulate you into buying premium. Could be anything, really. OpenAI is far from open.
- JSDevOps 2y agoNo, It's just because the service is overloaded