3 ms·
>this stuff is expensive to run What's expensive is innovating on current models and building the infrastructure. My understanding is inference is cheap and pr
by wyre 11mo ago
>this stuff is expensive to run
What's expensive is innovating on current models and building the infrastructure. My understanding is inference is cheap and profitable. Most open source models cost less than a dollar for 1 million tokens which makes me think SotA models likely have a similar pricepoint, but more profit margin.
- aeon_ai 11mo agoI can assure you that inference is not profitable if the user is paying nothing.
- rchaud 11mo agoDAU/MAU stats of free users have already carved out multi-millionaire and billionaire fortunes for employees and executives, all paid out with VC money. Plenty of people are profiting, even if the corporation is deep in the red.