5 ms·
Iirc the cache hit is 10% of normal input token cost. After the hour you are charged 100% input token cost for the whole conversation.
by bakies 3mo ago
Iirc the cache hit is 10% of normal input token cost. After the hour you are charged 100% input token cost for the whole conversation.