3 ms·
I imagine this price will come down over time. OpenAI has repeatedly said that they haven't the infrastructure in place yet to handle too much load and expect t
by Veen 4y ago
I imagine this price will come down over time. OpenAI has repeatedly said that they haven't the infrastructure in place yet to handle too much load and expect to be "severely capacity constrained", so I assume the high pricing and usage caps on the ChatGPT version are to keep the load manageably low for the moment.
- avisser 4y agoI imagine those dollars from papa Nadella are buying LOTS of capacity as we speak.
- aiappreciator 4y agoIts not $ constrained. The existing cloud providers don't have 10000 A100s lying around to ramp up at any time. There's a very limited amount of A100s and H100s on the market. TSMC is printing them like candy, but it still takes time to ramp up. Azure also needs time to install them in datacenters. These A100s stacks probably produce monstrous amounts of heat compared to normal CPU racks.
- jazzyjackson 4y agoYou're not wrong but I think many people still have an intuition informed by a pre-silicon-capacity-crunch era, it cannot be taken for granted that the demand for GPU / TPU will be met over the next few years.