4 ms·
But what about the training cost?
by prism56 1y ago
But what about the training cost?
- timmg 1y agoIt would be interesting to know how many queries they get per "base" model. I honestly have no idea what the scale is. In any case, that's the only way to know how to amortize training cost over inference.