It would be interesting to know how many queries they get per "base" model. I honestly have no idea what the scale is. In any case, that's the only way to kno

It would be interesting to know how many queries they get per "base" model. I honestly have no idea what the scale is. In any case, that's the only way to know how to amortize training cost over inference.