10 ms·
I don't think that's clear. They're certainly burning money, but that's mostly R&D: salaries and training compute. Once you remove those, it's unclear whet
by bryanlarsen 9mo ago
I don't think that's clear. They're certainly burning money, but that's mostly R&D: salaries and training compute. Once you remove those, it's unclear whether the AI companies would be losing money on just inference.
- bombolo 9mo ago[dead]
- dns_snek 9mo agoYou can't "remove" costs willy nilly to make a company look profitable. Running an independent ISP is an extremely lucrative business if you gloss over the capex requirements of installing and maintaining the infrastructure.
- bryanlarsen 9mo agoYou don't remove them willy-nilly, but evaluating companies based on their operating costs is standard accounting practice. R&D is not part of operating costs. Capex for inference is in, capex for training is out for that analysis.
- dns_snek 9mo agoHow much inference are they going to sell a year from now if they stop R&D? Any comparison excluding those costs is either misguided or fraudulent.
- bryanlarsen 9mo agoIt's one of the key metrics of a business. These are growth businesses, everybody assumes they're going to have a lot more customers in the future than they have today. If they've got X times as many customers next year than they have right now, training costs per customer gets divided by X, but inference costs per customer stay roughly constant. So for businesses where they expect X to be large, they care about operating costs a heck of a lot more than R&D.