4 ms·

Because building a frontier model is expensive. But building a model as good as an existing frontier model is cheap (re: distillation). https://en.m.wikipedia.

Because building a frontier model is expensive. But building a model as good as an existing frontier model is cheap (re: distillation). https://en.m.wikipedia.org/wiki/Knowledge_distillation https://en.m.wikipedia.org/wiki/Knowledge_distillation So the takeaway is they have no moat

infecto 2y ago
Beautiful and concise, much better than my word salad.
majewsky 2y ago
Link without mobile UI: https://en.wikipedia.org/wiki/Knowledge_distillation https://en.wikipedia.org/wiki/Knowledge_distillation