2 ms·
People certainly knew that language modeling was a key unsupervised objective to unlock inference on language. I agree that I think they underestimated quite h
by whimsicalism 4y ago
People certainly knew that language modeling was a key unsupervised objective to unlock inference on language.
I agree that I think they underestimated quite how useful a product could be built around just the language modeling objective, but it's still been critical for most NLP advances of the last ~6+ years.