3 ms·
API calls get more expensive, not less, as you've loaded more context. This is exactly when you want to switch to cheaper models.
by csullivannet 1mo ago
API calls get more expensive, not less, as you've loaded more context. This is exactly when you want to switch to cheaper models.
- camdenreslink 1mo agoThere is caching to consider. Switching models throws away the cached tokens.