6 ms·

AMD, Alibaba should be on there too. AMD is making good money on AI, with R&D at less than half the AI revenue. Whereas Alibaba's weird financials show it's kin

AMD, Alibaba should be on there too. AMD is making good money on AI, with R&D at less than half the AI revenue. Whereas Alibaba's weird financials show it's kinda-sorta-protifable? I just wanna know how the OpenAI/Anthropic shell game works long-term. So both companies made equity deals with infrastructure providers; OpenAI on Azure, Anthropic on AWS, GCloud, and Colossus. They get a loan of compute credits and then pay for the compute with the credits. So the PaaS are effectively giving them free compute, then book it as revenue; and the AI provider lets them do inference and books that as revenue. So, it's like both types of company have a buffet, and let each other eat there for free. But somebody has to actually buy the pasta salad, with real dollars. Afaict, those real dollars are.... the cash reserves of the PaaS. How long are they going to eat into that cash? Microsoft and AWS don't really have their own models, whereas Google and SpaceX do. And while Google has tons of cash, SpaceX is perpetually looking for cash. So the only player here that can actually afford to keep doing this, or leave the game entirely, is Google.

wmf 5mo ago
There's a lot of revenue and outside investment coming in but the haters pretend it's all circular financing.
- nextaccountic 5mo ago
  Outside investment is not a revenue, it's looking more like a pyramid scheme. It's yet more people putting their money in the scheme expecting a return Either the actual revenue of paying customers ramp up or the bubble will pop at some point I expect the paying customers will actually be companies buying ad, not people buying AI subscriptions
- deleted 5mo ago
  [deleted]
harrall 5mo ago
Household names like Uber, Amazon, Blue Bottle Coffee and Fedex used the same playbook of burning investors’ cash for years and look where they’re now. Everyone’s long term plan is hoping that they build out and survive long enough that, in the end, the market accepts them. Even your local still-unprofitable restaurant is burning their grandparents’ inheritance money hoping that it works out. But on the other hand, that’s what Theranos, WeWork, and Pets.com tried too.
- 0xbadcafebee 5mo ago
  The old model works at tens of millions, not hundreds of billions. All the private capital is pretty tapped out, and banks aren't loaning (thank god). So they don't have investor money to burn (and when they do, they immediately burn it on new datacenters, which usually take years to build and aren't a certainty). That's why they made equity deals with hardware companies... it was the only way they could "afford" hardware. But someone has to pay for that hardware. And the person paying is... the hardware companies. They have a lot of cash, but not hundreds of billions of cash. Hence why Oracle pulled out, Nvidia scaled back its investment. Claude only doesn't suck right now because SpaceX literally loaned them a datacenter. So I'm saying... these companies will run out of cash, if they can't get paid back, sooner than later. When OpenAI goes public it will initially get a tsunami of cash, but it'll also be open to new risk due to the different operating model and transparency. Anthropic might not make it to an S-1 (this year). Even if they got a $30B infusion of cash each, based on their current spending projections, it doesn't cover half of what they need just to break even. In the meantime the PaaS's are holding the bag (and shedding cash). So where's it going to end? To me, all of this (combined with inflation, degrading of reserve currency, war in middle east) is spookily similar to the railroad panic of 1873. Over-investment in new technologies leveraging too much from the largest financial institutions resulting in prolonged economic crisis. Our only saving grace now are laws ensuring banks have to cover their end; if your money's FDIC/SIPC insured you're safe. But all the businesses and individuals who aren't safe are gonna take a bath, which'll have systemic ripples. Afaict, Google is the only player who can survive all that and come out with profitable AI. (But I'm sure I've missed something because it seems too obvious)
  - zozbot234 5mo ago
    They just have to incrementally raise the price of inference tokens and limit subscriptions to curtail existing demand (with much of it likely moving to slower and cheaper local models). Which, come to think of it, is exactly what seems to be happening right now. > So they don't have investor money to burn (and when they do, they immediately burn it on new datacenters, which usually take years to build and aren't a certainty). If AI models can get smarter and more practically useful via some combination of increased scale and more fine-tuned post-training on specific workloads (which is compute-heavy, even more than the usual kind of pre-training) these new datacenters are a fantastic investment.
7thpower 5mo ago
With this line of thinking, nobody would have ever built refineries, or fabs, or clouds. The frontier labs have fantastic margin on inference. You do not understand how fantastic. And they have license to change inputs at will based on profitability. They are not only innovating on models and tooling, they are innovating on cogs (I wrote this btw, and I’m not going to stop writing this way because Claude discovered it’s brilliant). Speaking of models, the cost of training is not scaling nearly as fast as demand for inference. Training used to be the biggest cost by far, now it’s not. So margin is increasing, and guess what else is happening? Customers are finding value. And the customers that are finding value are also the ones who happen to have huge enterprise budgets. And while this is happening, so is implicit collusion (and lock in, and hype, and all that). And so prices are going up. They’re going to be just fine man, there is no inference bubble. They can modulate supply. It’s all going to be fine. You should invest.
- sfifs 5mo ago
  > The frontier labs have fantastic margin on inference. You do not understand how fantastic. And they have license to change inputs at will based on profitability. This. The gross margin on inference is at least 95% if not higher - several open weight models on my tiny consumer DGX Spark easily replace the 15 dollars a day I was paying in tokens for Claw usage with a dollar a day electricity. You add data centre overhead and depreciation, the theoretical net margin will trend lower but depreciation is always far more aggressive than actual product degradation. The old NVIDIA GPU on a 9 year old second hand gaming PC I bought still serves up a small Gemma 4 variant quite reasonably.
  - spwa4 5mo ago
    To say nothing of the fact that they can just add "figure out how to change the answer to this question to benefit X" at the top of their system query. It is baffling that any government lets either themselves or their local companies use these tools. Utterly baffling. The potential for total security compromise through these models is ... essentially 100%. But ... it's slightly cheaper.
- gizzlon 5mo ago
deleted 5mo ago
[deleted]

wmf 5mo ago

There's a lot of revenue and outside investment coming in but the haters pretend it's all circular financing.

nextaccountic 5mo ago
Outside investment is not a revenue, it's looking more like a pyramid scheme. It's yet more people putting their money in the scheme expecting a return Either the actual revenue of paying customers ramp up or the bubble will pop at some point I expect the paying customers will actually be companies buying ad, not people buying AI subscriptions
deleted 5mo ago
[deleted]

harrall 5mo ago

Household names like Uber, Amazon, Blue Bottle Coffee and Fedex used the same playbook of burning investors’ cash for years and look where they’re now. Everyone’s long term plan is hoping that they build out and survive long enough that, in the end, the market accepts them. Even your local still-unprofitable restaurant is burning their grandparents’ inheritance money hoping that it works out. But on the other hand, that’s what Theranos, WeWork, and Pets.com tried too.

0xbadcafebee 5mo ago
The old model works at tens of millions, not hundreds of billions. All the private capital is pretty tapped out, and banks aren't loaning (thank god). So they don't have investor money to burn (and when they do, they immediately burn it on new datacenters, which usually take years to build and aren't a certainty). That's why they made equity deals with hardware companies... it was the only way they could "afford" hardware. But someone has to pay for that hardware. And the person paying is... the hardware companies. They have a lot of cash, but not hundreds of billions of cash. Hence why Oracle pulled out, Nvidia scaled back its investment. Claude only doesn't suck right now because SpaceX literally loaned them a datacenter. So I'm saying... these companies will run out of cash, if they can't get paid back, sooner than later. When OpenAI goes public it will initially get a tsunami of cash, but it'll also be open to new risk due to the different operating model and transparency. Anthropic might not make it to an S-1 (this year). Even if they got a $30B infusion of cash each, based on their current spending projections, it doesn't cover half of what they need just to break even. In the meantime the PaaS's are holding the bag (and shedding cash). So where's it going to end? To me, all of this (combined with inflation, degrading of reserve currency, war in middle east) is spookily similar to the railroad panic of 1873. Over-investment in new technologies leveraging too much from the largest financial institutions resulting in prolonged economic crisis. Our only saving grace now are laws ensuring banks have to cover their end; if your money's FDIC/SIPC insured you're safe. But all the businesses and individuals who aren't safe are gonna take a bath, which'll have systemic ripples. Afaict, Google is the only player who can survive all that and come out with profitable AI. (But I'm sure I've missed something because it seems too obvious)
- zozbot234 5mo ago
  They just have to incrementally raise the price of inference tokens and limit subscriptions to curtail existing demand (with much of it likely moving to slower and cheaper local models). Which, come to think of it, is exactly what seems to be happening right now. > So they don't have investor money to burn (and when they do, they immediately burn it on new datacenters, which usually take years to build and aren't a certainty). If AI models can get smarter and more practically useful via some combination of increased scale and more fine-tuned post-training on specific workloads (which is compute-heavy, even more than the usual kind of pre-training) these new datacenters are a fantastic investment.

7thpower 5mo ago

With this line of thinking, nobody would have ever built refineries, or fabs, or clouds. The frontier labs have fantastic margin on inference. You do not understand how fantastic. And they have license to change inputs at will based on profitability. They are not only innovating on models and tooling, they are innovating on cogs (I wrote this btw, and I’m not going to stop writing this way because Claude discovered it’s brilliant). Speaking of models, the cost of training is not scaling nearly as fast as demand for inference. Training used to be the biggest cost by far, now it’s not. So margin is increasing, and guess what else is happening? Customers are finding value. And the customers that are finding value are also the ones who happen to have huge enterprise budgets. And while this is happening, so is implicit collusion (and lock in, and hype, and all that). And so prices are going up. They’re going to be just fine man, there is no inference bubble. They can modulate supply. It’s all going to be fine. You should invest.

sfifs 5mo ago
> The frontier labs have fantastic margin on inference. You do not understand how fantastic. And they have license to change inputs at will based on profitability. This. The gross margin on inference is at least 95% if not higher - several open weight models on my tiny consumer DGX Spark easily replace the 15 dollars a day I was paying in tokens for Claw usage with a dollar a day electricity. You add data centre overhead and depreciation, the theoretical net margin will trend lower but depreciation is always far more aggressive than actual product degradation. The old NVIDIA GPU on a 9 year old second hand gaming PC I bought still serves up a small Gemma 4 variant quite reasonably.
- spwa4 5mo ago
  To say nothing of the fact that they can just add "figure out how to change the answer to this question to benefit X" at the top of their system query. It is baffling that any government lets either themselves or their local companies use these tools. Utterly baffling. The potential for total security compromise through these models is ... essentially 100%. But ... it's slightly cheaper.
gizzlon 5mo ago

deleted 5mo ago

[deleted]