3 ms·
I think you missed the point here. The author is showing exactly why this is a big problem in NLP, beyond the test/train split issue. Even with test/train spli
by nl 9y ago
I think you missed the point here. The author is showing exactly why this is a big problem in NLP, beyond the test/train split issue.
Even with test/train splits you still need to smooth your model's predictions because it will always get unseen words. That's just the nature of word based lanugage models.