3 ms·
I think in this case it is more tweaking for inference cost. The full models are never exposed as using them at scale is too expensive.
by PeterStuer 2y ago
I think in this case it is more tweaking for inference cost. The full models are never exposed as using them at scale is too expensive.