3 ms·
From a naive perspective, it seems that true research/advances in AI (methods of training, etc) aren't necessarily related to model size. It seems that the goal
by nomel 3y ago
From a naive perspective, it seems that true research/advances in AI (methods of training, etc) aren't necessarily related to model size. It seems that the goal of "building a big model that everyone else converges to because the training data is the same" doesn't have all that much value, especially since you could wait a couple years, do it all for a fraction of the price, and catch up immediately. Meta doesn't have an AI product yet, so it's not like they would be loosing money.
I suspect this is more about talent attraction/retention.