3 ms·

I see so that means this GPT Neo is 64 less powerful?

• Voloskaya 6y ago
  Accuracy and numbers of parameters don't scale linearly together. It varies widely depending on exactly what you are measuring accuracy on as well etc. But a very approximate rule of thumb would be to say that accuracy scales with the log of the parameter count (for the same architecture).