5 ms·
These small models only make sense with "thinking" enabled. And once you enable that, much of the cost advantage vanishes, for output tokens.
by ein0p 1y ago
These small models only make sense with "thinking" enabled. And once you enable that, much of the cost advantage vanishes, for output tokens.
- overfeed 1y ago> These small models only make sense with "thinking" enabled This entirely depends on your use-cases.