3 ms·
The implementation details are irrelevant to the discussion of the true cost of running the models.
by lostmsu 8mo ago
The implementation details are irrelevant to the discussion of the true cost of running the models.
- mzl 8mo agoThe cost of running things like prompt caching is defined by the implementation as that gives the infrastructure costs.