3 ms·
I don’t see how they could credibly estimate inference costs without knowing the model size.
by p-e-w 1mo ago
I don’t see how they could credibly estimate inference costs without knowing the model size.
- FuckButtons 1mo agoBut we do have a reasonable estimate of model size.
- nbardy 1mo agoYou can estimate the model size by looking at tokens per second and comparing to open source models