3 ms·
But then you try to predict the next token on a completely unseen piece of the corpus and fail miserably if all you do is store the training data.
by visarga 5y ago
But then you try to predict the next token on a completely unseen piece of the corpus and fail miserably if all you do is store the training data.