2 ms·
I don't understand what you are arguing. >>> the maximum-likelihood model is one where the frequency of every word is the frequency that you observed that word
by nl 9y ago
I don't understand what you are arguing.
>>> the maximum-likelihood model is one where the frequency of every word is the frequency that you observed that word, and the frequency of unseen words is 0
>> I think that's false. A model may never reduce any probability to zero. Novel data is a normal feature of modelling.
> But there are better ways to build a model.
Yes of course there are. That's exactly what the OP said ("You correct it by being an intelligent human who knows the maximum-likelihood model is wrong, and applying a correction on top of it") but you seemed to be arguing against it.
(And to be clear, there are also alternatives to the maximum likelihood model)