3 ms·
With how competitive the LLM field is, it would surprise me greatly if any of these players were doing anything other than trying to make the best possible prod
by daishi55 2mo ago
With how competitive the LLM field is, it would surprise me greatly if any of these players were doing anything other than trying to make the best possible product. I certainly do not believe they are intentionally training the models to use more tokens unnecessarily.
- cyanydeez 2mo agoTheyre training the system to minimize compute,so most likely theyre dynamically downgrading quants in the first few turns hoping to find the cheapest model to run. The side effect may be excessive token gen
- hmokiguess 2mo agoAre you implying they can’t do both?
- daishi55 2mo agoYes, those things are mutually exclusive.
- LaGrange 2mo agoYou're joking, right? That's an incredibly outmoded view of capitalist "competition."
- owebmaster 2mo agoThere is a theory that the verbosity and comments help getting better results with the current benchmarks. So the models are theoretically getting better but in practice they are getting worse.
- gwerbin 2mo agoI believe they are genuinely getting better for fully autonomous tasks. Anthropic seems to have gone all in on this, at the expense of more typical usage patterns.