3 ms·
"ChatGPT regularly displays "too busy" messages." ChatGPT scaled from 0 users to 100 million in 2 months. Probably millions online at any given second. Its to
by anonylizard 4y ago
"ChatGPT regularly displays "too busy" messages."
ChatGPT scaled from 0 users to 100 million in 2 months. Probably millions online at any given second.
Its too busy, because it literally exhausted all the GPUs Azure has as its disposal.
Without the Cloud, scaling ChatGPT would have been impossible. It would have been nowhere near its current success.
Remember that GPT3 was released to the public in Mid 2022, had no public reaction, because it was put behind a paywall. ChatGPT had to be free, and able to cope with the load, to be successful.
- mattmanser 4y agoFalse. It is not coping with the load. It is successful. Therefore, it did not have to be able to cope with the load to be successful. All you did is illustrate my point.
- Salgat 4y agoThat's because ChatGPT was able to sustain service past the point of mass adoption. You're not going to scale to millions of users in a short timespan with dedicated hardware.