3 ms·
Beginning-of-prompt common prefixes are very cheap for the provider depending on their caching architecture. Wouldn't be surprised if you're paying full price
by londons_explore 3mo ago
Beginning-of-prompt common prefixes are very cheap for the provider depending on their caching architecture.
Wouldn't be surprised if you're paying full price for those tokens, but they cost ~$0 for the provider.