3 ms·
Maybe the reverse is true? To provide faster performance they dumb down gpt4 (quantization?) that serves the chatgpt UI but the API is full power albeit slow.
by danielbln 3y ago
Maybe the reverse is true? To provide faster performance they dumb down gpt4 (quantization?) that serves the chatgpt UI but the API is full power albeit slow.
- jonplackett 3y agoI think it’s just prioritising ChatGPT. The reason that’s my guess is that the API is occasionally much faster and then goes slow again. It’s a bit all over the place which leads me to suspect it’s based on demand