This article on OpenAI prompt caching was interesting https://platform.openai.com/docs/guides/prompt-caching https://platform.openai.com/docs/guides/prompt-cach

This article on OpenAI prompt caching was interesting https://platform.openai.com/docs/guides/prompt-caching https://platform.openai.com/docs/guides/prompt-caching As someone who definitely doesn’t know what they’re talking about, I’m going to guess that some analogous optimizations might apply to Claude. Something something… TPU slice cache locality… guestures vaguely