3 ms·
The cost of running things like prompt caching is defined by the implementation as that gives the infrastructure costs.
by mzl 8mo ago
The cost of running things like prompt caching is defined by the implementation as that gives the infrastructure costs.