4 ms·
Well the inference time of gpt4 seems to be far greater than gpt3, so it could hint a difference in parameters count.
by qumpis 4y ago
Well the inference time of gpt4 seems to be far greater than gpt3, so it could hint a difference in parameters count.
- LesZedCB 4y agoif you watch their announcement Livestream video it looked just as fast as normal ChatGPT. I think what we have access to is a fair bit slower.