2 ms·
If they wanted to play games with sub tiers they would just change the rate limits rather than wasting inference.
by bpodgursky 3mo ago
If they wanted to play games with sub tiers they would just change the rate limits rather than wasting inference.
- crewindream 3mo agoFlip side is customer psychology. Choosing a more expensive tier leaves better emotion. Also i doubt there was jira ticket with “make llm more verbose”, rather ticket with “bug makes llms too verbose” gets prioritised taking revenue impact into account.