2 ms·
Write a detailed plan using a more expensive model and implement it using the cheaper one.
by denverllc 3mo ago
Write a detailed plan using a more expensive model and implement it using the cheaper one.
- blfr 3mo agoHow much are you saving once the more expensive model already has all the context loaded and ready to go?
- csullivannet 3mo agoAPI calls get more expensive, not less, as you've loaded more context. This is exactly when you want to switch to cheaper models.
- camdenreslink 3mo agoThere is caching to consider. Switching models throws away the cached tokens.