I don’t think that it got more efficient. It’s that smaller models can train via larger ones cheaply. Think teacher/student relationship https://en.m.wikipedia

I don’t think that it got more efficient. It’s that smaller models can train via larger ones cheaply. Think teacher/student relationship https://en.m.wikipedia.org/wiki/Knowledge_distillation https://en.m.wikipedia.org/wiki/Knowledge_distillation