3 ms·

So it includes both tiny models and large models?

• mgraczyk 1y ago
  I would assume so. One important trend is that models have gotten more intelligent for the same size, so for a given product you can use a smaller model. Again this is pretty similar to how CPUs have changed
  • immibis 1y ago
    So it's not a specific product doing a specific thing, but the average across different things?