4 ms·
> "Being cheap allows them to capture the market faster." I think it's worth remarking that this is IMO a smarter way of using price to capture market than wha
by potatolicious 4y ago
> "Being cheap allows them to capture the market faster."
I think it's worth remarking that this is IMO a smarter way of using price to capture market than what we've seen in the post decade (see: Uber, DoorDash) - in OpenAI's case there's every reasonable expectation that they can drop their operating costs well below the low prices they're offering, so if they are running in the red the expectation of temporariness is reasonable.
What was unreasonable about the past tech cycle is that a lot of the expectations of cost reduction a) never panned out, and b) if subjected to even slight scrutiny would never have reasonably panned out.
OpenAI has direct line-of-sight to getting these models dramatically cheaper to run than now, and that's a huge benefit.
That said I remain a bit skeptical about the market overall here - I think the tech here is legitimately groundbreaking, but there are a few forces working against this as a profitable product:
- Open source models and weights are catching up very rapidly. If the secret sauce is sheer scale, this will be replicated quickly (and IMO is happening). Do users need ChatGPT or do they need any decently-sized LLM?
- Productization seems like it will largely benefit incumbent large players (see: Microsoft, Google) who can afford to tank the operating costs and additional R&D required on top to productize. Those players are also most able to train their own LLMs and operate them directly, removing the need for a third party provider.
It seems likely to me that this will break in three directions (and likely a mixture of them):
- Big players train their own LLMs and operate them directly on their own hardware, and do not do business with OpenAI at any significant volume.
- Small players lean towards undifferentiated LLMs that are open source and run on standard cloud configurations.
- Small players lean towards proprietary, but non-OpenAI LLMs. There's no particular reason why GCP and AWS cannot offer a similar product and undercut OpenAI.