3 ms·
> ChatGPT was down, so of course it'd be slower Actually at Google scale I wouldn't expect so
by willsmith72 3y ago
> ChatGPT was down, so of course it'd be slower
Actually at Google scale I wouldn't expect so
- kccqzy 3y agoYeah but Google missed the boat when it came to hardware accelerators specifically meant for LLMs (their proprietary TPUs aren't optimized for LLMs) so it's just a matter of whether Google or Microsoft paid Nvidia more. In the current cost cutting climate at Google I doubt the answer is so certain.
- fennecfoxy 3y agoIdk I think there's a bit of a difference between a session for some basic website vs machine learning stuff. The base perf cost per user is muuuuuch higher for ML.