5 ms·

Gemini caching is confusing though: $0.15 / million tokens $1.00 / 1,000,000 tokens per hour (storage price) I much prefer the OpenAI/DeepSeek way of pric

by simonw 6mo ago

Gemini caching is confusing though: $0.15 / million tokens $1.00 / 1,000,000 tokens per hour (storage price) I much prefer the OpenAI/DeepSeek way of pricing caching where you don't have to think about storage price at all - you pay for cached tokens if you reuse the same prefix within a (loosely defined) time period.

simonw 6mo ago
As far as I can tell Gemini caching DOES work like OpenAI - see implicit caching here: https://ai.google.dev/gemini-api/docs/caching https://ai.google.dev/gemini-api/docs/caching I confirmed this by running a bunch of prompts through Gemini 3.5 Flash without doing anything special to configure caching and noting that it comes back with a "cachedContentTokenCount" on many of the responses. The "storage price" quoted is for an optional Gemini feature that most people don't care about: https://ai.google.dev/gemini-api/docs/caching#explicit-caching https://ai.google.dev/gemini-api/docs/caching#explicit-cachi...