4 ms·
Basically, if I understand correctly, the "status quo" was that the big models by OpenAI and Google that are much better (raw) than anything that was open sourc
by cube2222 3y ago
Basically, if I understand correctly, the "status quo" was that the big models by OpenAI and Google that are much better (raw) than anything that was open source recently, would remain the greatest, and the moat would be the technical complexity of training and running those big models.
However, the open sourcing led to tons of people exploring tons of avenues in an extremely quick fashion, leading to the development of models that are able to close in on that performance in a much smaller envelope, destroying the only moat and making it possible for people with limited resources to experiment and innovate.
- galaxyLogic 3y ago> big models by OpenAI and Google that are much better (raw) than anything that was open source recently, When you say "models" do you mean TRAINED models? Wouldn't the best training and supervised/feedback learning still be in the hands of the big players? An open source "model" of all content in the open internet is great, but it has the garbage-in/garbage-out problem.