2 ms·
Which is exactly the point he's making, I believe; that simply collecting more data isn't the next step. That we've reached a local plateau in scaling ability b
by bbor 2y ago
Which is exactly the point he's making, I believe; that simply collecting more data isn't the next step. That we've reached a local plateau in scaling ability based on corpus size. Which was assumed by pretty much everyone outside the DL elite the whole time, AFAIU
- esperent 2y agoRight, but there's nothing new in that statement. I've been hearing that we're running out of data for training AIs for two years at least.