4 ms·
LLM companies are incentives for the opposite. They don't want you to get the best outcome as quickly (or with as few tokens) as possible. They want to keep you
by scuff3d 7mo ago
LLM companies are incentives for the opposite. They don't want you to get the best outcome as quickly (or with as few tokens) as possible. They want to keep you on the slot machine. They want to maximize token use while giving just good enough results to not drive you to a competitor.
"Oh man, you're so close! If only you weren't out of tokens. Too bad you settled for the 20 dollar plan instead of the 200. One more prompt would do it, then everything would work perfectly"