3 ms·
>Companies doing foundational models need to cover the cost of training [...] But that's moving the goalposts? The original claim was on inference itself, not
by gruez 7mo ago
>Companies doing foundational models need to cover the cost of training [...]
But that's moving the goalposts? The original claim was on inference itself, not the whole company.
> The cost to serve tokens is absolutely profitable today and that’s been true for at least a year.
- lbreakjai 7mo agoBut that's the same as thinking "This bar is selling a cocktail for $15. I could make it at home for 30 cents. They're making $14.7 dollars of profit per cocktail, the owner must be a millionaire now!" Everything is profitable if you ignore the costs.