3 ms·

Has anyone tried Google's context caching feature? The minimum caching window being 32k tokens seems crazy to me.