2 ms·
When you know the context is a one-and-done. Caching costs more than just running the prompt, but less than running the prompt twice.
by adastra22 1y ago
When you know the context is a one-and-done. Caching costs more than just running the prompt, but less than running the prompt twice.