3 ms·
No one is losing money on inference these days. Google's vertical integration means that they have some of the lowest inference costs in the industry in any eve
by halJordan 5mo ago
No one is losing money on inference these days. Google's vertical integration means that they have some of the lowest inference costs in the industry in any event.
- fancyfredbot 5mo agoMicrosoft recently announced changes to copilot because, apparently, it was losing money on inference.
- kingstnap 5mo agoThey were loosing money giving absurdly generous agentic usage on expensive models to people with $10 to $40 flat rate subscriptions. They weren't selling inference.
- UltraSane 5mo agoThey were charging a flat rate per query no matter how many tokens it consumed. People naturally got very good at writing prompts that used as many tokens as possible.