2 ms·
But will the wrapper apps cover token cost, or will tokens act more like electricity?
by derwiki 3mo ago
But will the wrapper apps cover token cost, or will tokens act more like electricity?
- lumost 3mo agoToken cost is falling rapidly for a given quality. We don't think about this too much as newer models have made legacy apps obsolete - but its an interesting question what the cheapest text to sql or similar model would be. I still go by 10x cost decrease per 6 months for any given model quality.