3 ms·
The LLMs are better at enforcing their boundaries than developers. Run out of tokens? That's it. No more code. It doesn't care how much the company needs this f
by hexasquid 3mo ago
The LLMs are better at enforcing their boundaries than developers. Run out of tokens? That's it. No more code. It doesn't care how much the company needs this for the customer call tomorrow.
- bonesss 3mo agoI feel that’s the opposite of the LLM-business models. If I run out of tokens I’m encouraged to spend money to buy more tokens, Claude has an overage setup, and Anthropic runs occasional token sales. So, to that example: the more often customers are hitting token limits under duress the more likely to open up the wallet and pay to finish.
- nekusar 3mo agoSo, its drug dealer economics. Run out of your fix? (Tap tap) Buy some more!