3 ms·
ChatGPT was down, so of course it'd be slower. And possibly that accounts for some quality loss as well. For a fair comparison, you probably need to try while
by Filligree 3y ago
ChatGPT was down, so of course it'd be slower. And possibly that accounts for some quality loss as well.
For a fair comparison, you probably need to try while ChatGPT is working.
- IanCal 3y agoThe extension with gpt4 as a backend was ime extremely slow as standard. I've not tried it again with the v7 model though which is supposed to be a lot faster
- hfjjbf 3y ago[dead]
- willsmith72 3y ago> ChatGPT was down, so of course it'd be slower Actually at Google scale I wouldn't expect so
- kccqzy 3y agoYeah but Google missed the boat when it came to hardware accelerators specifically meant for LLMs (their proprietary TPUs aren't optimized for LLMs) so it's just a matter of whether Google or Microsoft paid Nvidia more. In the current cost cutting climate at Google I doubt the answer is so certain.
- fennecfoxy 3y agoIdk I think there's a bit of a difference between a session for some basic website vs machine learning stuff. The base perf cost per user is muuuuuch higher for ML.