5 ms·
They are running at capacity now. Can they scale fast enough?
by ffhhj 4y ago
They are running at capacity now. Can they scale fast enough?
- lopis 4y agoThey are running at capacity for free users. They will be able to afford much higher capacity with MS money, and probably stop providing the service for free soon.
- cactusplant7374 4y agoOne request costs about 1 cent to process? Is that what Altman is saying?
- ilaksh 4y agoThe APIs requests for the text-davinci-003 model released around the same time as ChatGPT also frequently fail with 503 errors.
- deleted 4y ago[deleted]
- bfeynman 4y agothey aren't running out of capacity, they just can't afford 100k+ a day in compute. Number of users who will pay will be much less so I doubt they will have problems
- ddmma 4y agoThey create the need by building limitations on the free tier.
- dragonwriter 4y agoThey have as many frre users as they are willing to pay for to present a free demo; rest assured that the fee for paid users is more than sufficient to pay for whatever capacity they need.