3 ms·
doesn't it get very expensive quickly if you don't use prompt cashing
by singularity2001 2y ago
doesn't it get very expensive quickly if you don't use prompt cashing
- simonw 2y agoI've had the occasional large prompt that cost ~30c - I often use GPT-4o mini if I'm going to ask follow-up questions because then I get prompt caching without having to configure it.