3 ms·You can estimate the model size by looking at tokens per second and comparing to open source modelsby nbardy 25d agoYou can estimate the model size by looking at tokens per second and comparing to open source models