3 ms·
They get paid for inference, those tokens might as well be monetary tokens.
by Workaccount2 10mo ago
They get paid for inference, those tokens might as well be monetary tokens.
- drw85 10mo agoThis is exactly the problem. Companies currently are being sold that they can replace employees with little agents that cost $20 to $200 a month. But then they realize that the $200 last for about 3.5 hours on day 1 of the month and the rest will be charged by the token. Which will then cost as much or more than the employee did, but with a nice guaranteed quota of non determinism and failure rate included.