4 ms·

The numbers in the article are forecasts but let’s take them as real. That’s $10bn of revenue, the majority from enterprise customers, let’s say 75% from enterp

The numbers in the article are forecasts but let’s take them as real. That’s $10bn of revenue, the majority from enterprise customers, let’s say 75% from enterprise API usage: $7.5 billion. If the margin on inference is 80% that means of the $7.5bn in enterprise revenue they’re spending $1.5bn on compute. Yet we know that they actually spend over $5bn per month on compute, which includes the $1.25bn per month to SpaceX. If $7.5bn is their enterprise revenue and it costs just $1.5bn to generate, that leaves $3.5bn in compute costs to account for. Dario previously said that training costs less than inference so training can’t explain it. If subscriptions aren’t the majority of usage and aren’t subsidized, where is the money going? Anthropic don’t spend money on data centre build out so that can’t be it either.

nl 12d ago
> If the margin on inference is 80% that means of the $7.5bn in enterprise revenue they’re spending $1.5bn on compute. I don't think you can reverse this out like this because the 80% rate is before payments to "distribution partners, including Amazon". I think that payment includes the hosting cost for that those model but it's unclear. > Dario previously said that training costs less than inference Do you have a source for that? Are you sure you aren't conflating the statements Dario has made that training costs less than they make on inference (over the life cycle of a model)?
- reticulates 12d ago
  > I don't think you can reverse this out like this because the 80% rate is before payments to "distribution partners, including Amazon". I think that payment includes the hosting cost for that those model but it's unclear. The "hosting cost" is paid for by Anthropic and is the largest cost. The money Anthropic pay to Amazon for delivering Anthropic models via Bedrock is separate, independent of compute costs, best thought of as commission. The forecasted / guessed / estimated 80% number is based what customers pay per token minus the projected compute costs, i.e: the people who believe that Anthropic has 80% margins on tokens believe that Anthropic spend $0.20 on inference compute for every $1 of per-token billed-via-the-api revenue. We know that there are hundreds of thousands of fixed-price subscriptions being used to their absolute maximum, with many people bragging about how many subscriptions they run in parallel. These tokens are not included in the 80% margins, they are acknowledged to be "subsidized". People like @theo on Twitter post almost daily about how much they're milking Anthropic and OpenAI with leaderboards. Both Anthropic and OpenAI (more so OpenAI) do "resets" where they increase the limits available to people on their fixed price plans. We know that there are people paying $1,000 per month for multiple subscriptions to generate tokens that would cost $50,000 via the API. Even if Anthropic's margins are 80% on compute for per-token billing, that's still $10,000 of cost to Anthropic generating just $1,000 in revenue. Multiply that by tens of thousands or maybe even hundreds of thousands of subscriptions. Anthropic and OpenAI have raised over $100 billion each and continue to raise. If they're making 80% or even 50% margins on $10 billion in revenue per month they would not need to raise, they would be shouting for the roof tops about how profitable they are, they wouldn't be delaying their IPOs, yet they're only profitable by non-GAAP metrics like WeWork's classic "Community-adjusted EBITDA" or in this case "per-token-adjusted EBITDA" or whatever they will call it in their IPOs. Yes, they're selling tokens via the API for more than they cost, they are profitable on per-token billed inference, it has positive margins, but those profits are obliterated when you account for all the inference they're paying for out of pocket on fixed price subscriptions, upon which they keep increasing limits because they desperately need to show growth further harming their profitability (consuming all of the money they make from their API). If Anthropic and OpenAI needed to be profitable tomorrow, they could be, they could kill off all their fixed price subscription plans and charge only for usage via the API, they'd print money, but they'd lose mindshare because nobody except for enterprises can afford to pay the true cost, all the regular people would switch to cost effective good-enough models, and then within months, the enterprises would start to switch too because no longer would their employees be claude-pilled. Anthropic and OpenAI cannot turn off subsidization, thus, their margins on per-token API billing are not important in any discussion about their long term financial wellbeing. Just look at the large scale customers like Harvey (~15 trillion tokens per month, ~$50m+ in spend) who are, sensibly, investing in building their own specialized models that are cheap to run so they can cut their spend by 90%. That's profitable revenue for Anthropic / OpenAI today, but completely gone soon. > Do you have a source for that? https://www.youtube.com/watch?v=7xij6SoCClI https://www.youtube.com/watch?v=7xij6SoCClI "This week, Noah Smith and Erik Torenberg are joined by Dario Amodei, CEO and Co-founder of Anthropic. Dario talks about the economics of AI development, the comparative advantage of AI companies like Anthropic, AI safety, and his stance on California's SB 1047 bill. They also discuss the impacts of AI on global power dynamics, competition between the US and China, and inequality in an AI-powered world." At around 12 minutes in: "I think actually even if such a model is released one thing you know that's a this analogy to to open- Source software is that these big models they're actually very expensive to run on inference the majority of the cost is is inference not necessarily the training of the model so if you have only you know I don't know 10 20% 30% better way to do inference that can kind of negate the effect so the economics are kind of strange yes there's this giant fixed cost that you have to amortise but then there's also the per unit cost of inference and small differences in that can actually again assuming the thing is deployed widely enough make a very big difference so I don't know quite how that's going to play out" The scales have changed since then with inference costs falling and more being spent on training but the fundamentals are the same. Inference is expensive, in part, because peak usage dictates capacity whereas capacity can dictate training. Anthropic must pay billions of dollars per month to be able to handle peak inference, hence their efforts to try and shape usage by offering discounts / flexible limits at different times of the day. They can train when capacity permits.
  - nl 11d ago
    > The money Anthropic pay to Amazon for delivering Anthropic models via Bedrock is separate, independent of compute costs, best thought of as commission. My point is that you can't reverse out the maths like you did without knowing how much this is. > These tokens are not included in the 80% margins, they are acknowledged to be "subsidized". No, this isn't correct. Even including these they are claiming 80% margins. There's nothing at all that indicates subscriptions aren't included in this - it's a simple statement of their running margin. > these big models they're actually very expensive to run on inference the majority of the cost is is inference not necessarily the training of the model I don't think you can take this statement to claim that currently they spend more on inference than on training. I think he's saying over the lifetime of a model maybe inference ends up costing more unless they keep finding "better way to do inference that can kind of negate the effect". > If Anthropic and OpenAI needed to be profitable tomorrow, they could be, they could kill off all their fixed price subscription plans and charge only for usage via the API, they'd print money My point is that their subscription costs are a lot less than you think because of this statement by Anthropic that they have 80% margins including these subscriptions.
    - reticulates 11d ago
      Your version of reality cannot be real because the numbers do not make sense. Anthropic's supposed revenue run rate for 2026 puts December 2026's forecasted revenue at $10 billion. They're only "profitable" according to a non-GAAP measure that excludes all of their costs, they are not cash flow positive, they are not bringing in more money than they are spending. If their margins are 80%, that means on $10 billion in revenue they're spending just $2 billion. Anthropic's own announcements put their spending at much, much higher, such as the $1.25 billion per month they are paying to SpaceX for compute, and the ~$3.5 billion they're paying to Google each month, and the billions to Amazon each month too. https://www.anthropic.com/news/higher-limits-spacex https://www.anthropic.com/news/higher-limits-spacex > We’ve signed an agreement with SpaceX to use all of the compute capacity at their Colossus 1 data center. This gives us access to more than 300 megawatts of new capacity (over 220,000 NVIDIA GPUs) within the month. This additional capacity will directly improve capacity for Claude Pro and Claude Max subscribers. There's no world in which Anthropic has 80% margins. At their current expenditure on compute it would require at least $20 billion in revenue to be mathematically possible. The 80% figure on compute margins that is widely discussed is based on analysis by SemiAnalysis and refers only to their per-token compute margin (which is calculated comparing hardware costs + electricity costs to what they charge via the API). The estimated training costs for models like Opus and Astra are ~$1 billion and they're not training multiple frontier models in parallel every month. Training costs cannot explain where billions of dollars per month are disappearing if they have 80% margins. And that's before even considering all the money they're raising and spending. Anthropic raised tens of billions just a few months ago, OpenAI even more. Where is the money going?

nl 12d ago

> If the margin on inference is 80% that means of the $7.5bn in enterprise revenue they’re spending $1.5bn on compute. I don't think you can reverse this out like this because the 80% rate is before payments to "distribution partners, including Amazon". I think that payment includes the hosting cost for that those model but it's unclear. > Dario previously said that training costs less than inference Do you have a source for that? Are you sure you aren't conflating the statements Dario has made that training costs less than they make on inference (over the life cycle of a model)?

reticulates 12d ago
> I don't think you can reverse this out like this because the 80% rate is before payments to "distribution partners, including Amazon". I think that payment includes the hosting cost for that those model but it's unclear. The "hosting cost" is paid for by Anthropic and is the largest cost. The money Anthropic pay to Amazon for delivering Anthropic models via Bedrock is separate, independent of compute costs, best thought of as commission. The forecasted / guessed / estimated 80% number is based what customers pay per token minus the projected compute costs, i.e: the people who believe that Anthropic has 80% margins on tokens believe that Anthropic spend $0.20 on inference compute for every $1 of per-token billed-via-the-api revenue. We know that there are hundreds of thousands of fixed-price subscriptions being used to their absolute maximum, with many people bragging about how many subscriptions they run in parallel. These tokens are not included in the 80% margins, they are acknowledged to be "subsidized". People like @theo on Twitter post almost daily about how much they're milking Anthropic and OpenAI with leaderboards. Both Anthropic and OpenAI (more so OpenAI) do "resets" where they increase the limits available to people on their fixed price plans. We know that there are people paying $1,000 per month for multiple subscriptions to generate tokens that would cost $50,000 via the API. Even if Anthropic's margins are 80% on compute for per-token billing, that's still $10,000 of cost to Anthropic generating just $1,000 in revenue. Multiply that by tens of thousands or maybe even hundreds of thousands of subscriptions. Anthropic and OpenAI have raised over $100 billion each and continue to raise. If they're making 80% or even 50% margins on $10 billion in revenue per month they would not need to raise, they would be shouting for the roof tops about how profitable they are, they wouldn't be delaying their IPOs, yet they're only profitable by non-GAAP metrics like WeWork's classic "Community-adjusted EBITDA" or in this case "per-token-adjusted EBITDA" or whatever they will call it in their IPOs. Yes, they're selling tokens via the API for more than they cost, they are profitable on per-token billed inference, it has positive margins, but those profits are obliterated when you account for all the inference they're paying for out of pocket on fixed price subscriptions, upon which they keep increasing limits because they desperately need to show growth further harming their profitability (consuming all of the money they make from their API). If Anthropic and OpenAI needed to be profitable tomorrow, they could be, they could kill off all their fixed price subscription plans and charge only for usage via the API, they'd print money, but they'd lose mindshare because nobody except for enterprises can afford to pay the true cost, all the regular people would switch to cost effective good-enough models, and then within months, the enterprises would start to switch too because no longer would their employees be claude-pilled. Anthropic and OpenAI cannot turn off subsidization, thus, their margins on per-token API billing are not important in any discussion about their long term financial wellbeing. Just look at the large scale customers like Harvey (~15 trillion tokens per month, ~$50m+ in spend) who are, sensibly, investing in building their own specialized models that are cheap to run so they can cut their spend by 90%. That's profitable revenue for Anthropic / OpenAI today, but completely gone soon. > Do you have a source for that? https://www.youtube.com/watch?v=7xij6SoCClI https://www.youtube.com/watch?v=7xij6SoCClI "This week, Noah Smith and Erik Torenberg are joined by Dario Amodei, CEO and Co-founder of Anthropic. Dario talks about the economics of AI development, the comparative advantage of AI companies like Anthropic, AI safety, and his stance on California's SB 1047 bill. They also discuss the impacts of AI on global power dynamics, competition between the US and China, and inequality in an AI-powered world." At around 12 minutes in: "I think actually even if such a model is released one thing you know that's a this analogy to to open- Source software is that these big models they're actually very expensive to run on inference the majority of the cost is is inference not necessarily the training of the model so if you have only you know I don't know 10 20% 30% better way to do inference that can kind of negate the effect so the economics are kind of strange yes there's this giant fixed cost that you have to amortise but then there's also the per unit cost of inference and small differences in that can actually again assuming the thing is deployed widely enough make a very big difference so I don't know quite how that's going to play out" The scales have changed since then with inference costs falling and more being spent on training but the fundamentals are the same. Inference is expensive, in part, because peak usage dictates capacity whereas capacity can dictate training. Anthropic must pay billions of dollars per month to be able to handle peak inference, hence their efforts to try and shape usage by offering discounts / flexible limits at different times of the day. They can train when capacity permits.
- nl 11d ago
  > The money Anthropic pay to Amazon for delivering Anthropic models via Bedrock is separate, independent of compute costs, best thought of as commission. My point is that you can't reverse out the maths like you did without knowing how much this is. > These tokens are not included in the 80% margins, they are acknowledged to be "subsidized". No, this isn't correct. Even including these they are claiming 80% margins. There's nothing at all that indicates subscriptions aren't included in this - it's a simple statement of their running margin. > these big models they're actually very expensive to run on inference the majority of the cost is is inference not necessarily the training of the model I don't think you can take this statement to claim that currently they spend more on inference than on training. I think he's saying over the lifetime of a model maybe inference ends up costing more unless they keep finding "better way to do inference that can kind of negate the effect". > If Anthropic and OpenAI needed to be profitable tomorrow, they could be, they could kill off all their fixed price subscription plans and charge only for usage via the API, they'd print money My point is that their subscription costs are a lot less than you think because of this statement by Anthropic that they have 80% margins including these subscriptions.
  - reticulates 11d ago
    Your version of reality cannot be real because the numbers do not make sense. Anthropic's supposed revenue run rate for 2026 puts December 2026's forecasted revenue at $10 billion. They're only "profitable" according to a non-GAAP measure that excludes all of their costs, they are not cash flow positive, they are not bringing in more money than they are spending. If their margins are 80%, that means on $10 billion in revenue they're spending just $2 billion. Anthropic's own announcements put their spending at much, much higher, such as the $1.25 billion per month they are paying to SpaceX for compute, and the ~$3.5 billion they're paying to Google each month, and the billions to Amazon each month too. https://www.anthropic.com/news/higher-limits-spacex https://www.anthropic.com/news/higher-limits-spacex > We’ve signed an agreement with SpaceX to use all of the compute capacity at their Colossus 1 data center. This gives us access to more than 300 megawatts of new capacity (over 220,000 NVIDIA GPUs) within the month. This additional capacity will directly improve capacity for Claude Pro and Claude Max subscribers. There's no world in which Anthropic has 80% margins. At their current expenditure on compute it would require at least $20 billion in revenue to be mathematically possible. The 80% figure on compute margins that is widely discussed is based on analysis by SemiAnalysis and refers only to their per-token compute margin (which is calculated comparing hardware costs + electricity costs to what they charge via the API). The estimated training costs for models like Opus and Astra are ~$1 billion and they're not training multiple frontier models in parallel every month. Training costs cannot explain where billions of dollars per month are disappearing if they have 80% margins. And that's before even considering all the money they're raising and spending. Anthropic raised tens of billions just a few months ago, OpenAI even more. Where is the money going?