6 ms·
> In a pay per token situation, there is a huge conflict of interest with the harness provider and the token seller being the same party ... efficiency is less
by shric 3mo ago
> In a pay per token situation, there is a huge conflict of interest with the harness provider and the token seller being the same party ... efficiency is less profitable.
Except there’s a competitive incentive to either use less tokens or make the tokens go further
- blitzar 3mo agoWe are still in a (brief) era where companies are awarding pizza parties to the employees that burn the most tokens. There is a world where, to hit the next quarters revenue projection, you add 2,000 tokens to the system prompt and "beat" expectations at the next earnings release.