11 ms·
So they can charge more per token and decrease the pressure on their infra.
by yreg 2mo ago
So they can charge more per token and decrease the pressure on their infra.
- Someone 2mo agoEven if you specifically train the model on producing shorter answers, I would think producing good short answers would require more resources just as it does for humans (https://quoteinvestigator.com/2012/04/28/shorter-letter/ https://quoteinvestigator.com/2012/04/28/shorter-letter/: “If I Had More Time, I Would Have Written a Shorter Letter”) If so, charging per output token is the wrong incentive.
- yreg 2mo agoWhat billing system would you suggest?