4 ms·
https://www.axios.com/2025/08/15/sam-altman-gpt5-launch-chatgpt-future https://www.axios.com/2025/08/15/sam-altman-gpt5-launch-chat... quotes Sam Altman saying:
by simonw 1y ago
https://www.axios.com/2025/08/15/sam-altman-gpt5-launch-chatgpt-future https://www.axios.com/2025/08/15/sam-altman-gpt5-launch-chat... quotes Sam Altman saying:
> Most of what we're building out at this point is the inference [...] We're profitable on inference. If we didn't pay for training, we'd be a very profitable company.
- drob518 1y agoWhich is like saying, “If all we did is charge people money and didn’t have any COGS, we’d be a very profitable company.” That’s a truism of every business and therefore basically meaningless.
- deleted 1y ago[deleted]
- dcre 1y agoThe Amodei quote in my other reply explains why this is wrong. The point is not to compare the training of the current model to inference on the current model. The thing that makes them lose so much money is that they are training the next model while making back their training cost on the current model. So it's not COGS at all.
- prasadjoglekar 1y agoWell, only if the one training model continued to function as a going business. Their amortization window for the training cost is 2 months or so. They can't just keep that up and collect $. They have to build the next model, or else people will go to someone else.
- dcre 1y agoWhy two months? It was almost a year between Claude 3.5 and 4. (Not sure how much it costs to go from 3.5 to 3.7.)
- Jalad 1y agoEven being generous, and saying it's a year, most capital expenditures depreciate over a period of 5-7 years. To state the obvious, training one model a year is not a saving grace
- dcre 1y agoI don't understand why the absolute time period matters — all that matters is that you get enough time making money on inference to make up for the cost of training.
- oblio 1y agoDon't they need to accelerate that, though? Having a 1 year old model isn't really great, it's just tolerable.
- dcre 1y agoI think this is debatable as more models become good enough for more tasks. Maybe a smaller proportion of tasks will require SOTA models. On the other hand, the set of tasks people want to use LLMs for will expand along with the capabilities of SOTA models.
- ToucanLoucan 1y agoSo is OpenAI capable of not making a new model at some point? They've been training the next model continuously as long as they've existed AFAIK. Our software house spends a lot on R&D sure, but we're still incredibly profitable all the same. If OpenAI is in a position where they effectively have to stop iterating the product to be profitable, I wouldn't call that a very good place to be when you're on the verge of having several hundred billion in debt.
- dcre 1y agoI think at that point there is strong financial pressure to figure out how to continuously evolve models instead of changing new ones, for example by building models out of smaller modules that can be trained individually and swapped out. Jeff Dean and Noam Shazeer talked about that a bit in their interview with Dwarkesh: https://www.dwarkesh.com/p/jeff-dean-and-noam-shazeer https://www.dwarkesh.com/p/jeff-dean-and-noam-shazeer
- DenisM 1y agoThere’s still untapped value in deeper integrations. They might hit a jackpot of exponentially increasing value from network effects caused by tight integration with e.g. disjoint business processes. We know that businesses with tight network effects can grow to about 2 trillion in valuation.
- oblio 1y agoHow would that look with at least 3 US companies, probably 2 Chinese ones and at least 1 European company developing state of the art LLMs?
- drob518 1y agoSo,if they stopped training they’d be profitable? Only in some incremental sense, ignoring all sunk costs.
- gomox 1y agoI can't imagine the hoops an accountant would have to go through to argue training cost is COGS. In the most obvious stick-figures-for-beginners interpretation, as in, "If I had to explain how a P&L statement works to an AI engineer", training is R&D cost and inference cost is COGS.
- jgalt212 1y agothere's not a bright line there, though.
- drob518 1y agoI wasn’t using COGS in a GAAP sense, but rather as a synonym for unspecified “costs.” My bad. I suppose you would classify training as development and ongoing datacenter and GPU costs as actual GAAP COGS. My point was, if all you focus on is revenue and ignore the costs of creating your business and keeping it running, it’s pretty easy for any business to be “profitable.”
- DenisM 1y agoIt’s generally useful to consider unit economy separate from whole company. If your unit economy is negative thing are very bleak. If it’s positive, your chance are going up by a lot - scaling the business amortizes fixed (non-unit) costs, such as admin and R&D, and slightly improves unit margins as well. However this does not work as well if your fixed (non-unit) cost is growing exponentially. You can’t get out of this unless your user base grows exponentially or the customer value (and price) per user grows exponentially. I think this is what Altman is saying - this is an unusual situation: unit economy is positive but fixed costs are exploding faster than economy if scale can absorb it. You can say it’s splitting hair, but insightful perspective often requires teasing things apart.
- drob518 1y agoIt’s splitting a hair, but a pretty important hair. Does anyone think that models won’t need continuous retraining? Does anyone think models won’t continue to try to scale? Personally, I think we’re reaching diminishing returns with scaling, which is probably good because we’ve basically run out of content to train on, and so perhaps that does stop or at least slow down drastically. But I don’t see a scenario where constant retraining isn’t the norm, even if the rough amount of content we’re using for it grows only slightly.
- dcre 1y agoICYMI, Amodei said the same in much greater detail: "If you consider each model to be a company, the model that was trained in 2023 was profitable. You paid $100 million, and then it made $200 million of revenue. There's some cost to inference with the model, but let's just assume, in this cartoonish cartoon example, that even if you add those two up, you're kind of in a good state. So, if every model was a company, the model, in this example, is actually profitable. What's going on is that at the same time as you're reaping the benefits from one company, you're founding another company that's much more expensive and requires much more upfront R&D investment. And so the way that it's going to shake out is this will keep going up until the numbers go very large and the models can't get larger, and then it'll be a large, very profitable business, or, at some point, the models will stop getting better, right? The march to AGI will be halted for some reason, and then perhaps it'll be some overhang. So, there'll be a one-time, 'Oh man, we spent a lot of money and we didn't get anything for it.' And then the business returns to whatever scale it was at." https://cheekypint.substack.com/p/a-cheeky-pint-with-anthropic-ceo https://cheekypint.substack.com/p/a-cheeky-pint-with-anthrop...
- selimthegrim 1y agoThis sounds like fabs.
- whatshisface 1y agoI don't see why the declining marginal returns can't be continuous.
- 827a 1y agoOpenAI and Anthropic have very different customer bases and usage profiles. I'd estimate a significantly higher percentage of Anthropic's tokens are paid by the customer than OpenAI's. The ChatGPT free tier is magnitudes more popular than Claude's free tier, and Anthropic in all likelihood does a higher percentage of API business versus consumer business than OpenAI does. In other words, its possible this story is correct and true for Anthropic, but not true for OpenAI.
- dcre 1y ago
- ugh123 1y agoThat might be the case, but inference times have only gone up since GPT-3 (GPT-5 is regularly 20+ seconds for me).
- aeternum 1y agoThis can be technically true without being actually true. IE OpenAI invests in Cursor/Windsurf/Startups that give away credits to users and make heavy use of inference API. Money flows back to OpenAI then OpenAI sends it back to those companies via credits/investment $. It's even more circular in this case because nvidia is also funding companies that generate significant inference. It'll be quite difficult to figure out whether it's actually profitable until the new investment dollars start to dry up.
- milesskorpen 1y agoWhile this could be true, I don't think OpenAI is investing the $hundreds of millions-to-billions that would be required otherwise make it actually true. OpenAI's fund is ~$250-300mm Nvidia reportedly invested $1b last year - still way less than Open AI revenue
- onlyrealcuzzo 1y agoIt's even more circular, because Microsoft and Amazon also fund ChatGPT and Anthropic with Azure and AWS credits.
- citizenpaul 1y agoThere a journalist ed zittron https://www.wheresyoured.at/ https://www.wheresyoured.at/ That is an openai skeptic. His research if correct says not only is openai unprofitable but it likely never will be. Can't be ,its various finance ratios make early uber, amazon ect look downright fiscally frugal. He is not a tech person for what that means to you.
- oblio 1y agoAmazon was very frugal. If you look at Amazon losses for the first 10 years, they were all basically under 5% of revenue and many years were break even or slightly net positive. Uber burnt through a lot of money and even now I'm not sure their lifetime revenue is positive (it's possible that since their foundation they've lost more money than they've made).
- 827a 1y agoFrom the latest NYT Hard Fork podcast [1]. The hosts were invited to a dinner hosted by Sam, where Sam said "we're profitable if we remove training from the equation", they report he turned to Lightcap (COO) and asked "right?" and Lightcap gave an "eeekk we're close". They aren't yet profitable even just on inference, and its possible Sam didn't know that until very recently. [1] https://www.nytimes.com/2025/08/22/podcasts/is-this-an-ai-bubble-metas-missing-morals-tiktok-shock-slop.html https://www.nytimes.com/2025/08/22/podcasts/is-this-an-ai-bu...
- twoodfin 1y ago“We’re not profitable even if we discount training costs.” and “Inference revenue significantly exceeds inference costs.” are not incompatible statements. So maybe only the first part of Sam’s comment was correct.
- NoahZuniga 1y agoI imagine that one of the largest costs for openai is the wages they pay.
- 827a 1y agoI should have provided a direct quote: > At first, he answered, no, we would be profitable, if not for training new models. Essentially, if you take away all the stuff, all the money we’re spending on building new models and just look at the cost of serving the existing models, we are profitable on that basis. And then he looked at Brad Lightcap, who is the COO. And he sort of said, right? And Brad kind of squirmed in his seat a little bit and was like, well — He’s like, we’re pretty close. I don't think you can square that with what he stated in the Axios article: > "We're profitable on inference. If we didn't pay for training, we'd be a very profitable company." Except, if the NYT dinner happened after the Axios article interview, which is possible given when each was published, and he was actually literally unaware of the company's financials. Personally: it feels like it should reflect very poorly on OpenAI that their CEO has been, charitably, entirely unaware how close they are to profitability (and uncharitably, that he actively lies about it). But I'm not sure if the broader news cycle caught it; the only place I've heard this mentioned is literally this NYT Hard Fork podcast which is hosted by the people who were at the dinner.
- noodlescb 1y agoExcept these tech billionaires lie the most of the time. This is still the "grow at any cost" phase, so I don't even genuinely believe he has a confident understanding of how or at what point anything will be profitable. This just strikes me as the best answer he has at the moment.