3 ms·
And I'm saying, depends on how the model is built. If it is a simple dictionary then yes. But there are better ways to build a model. Its a naïve view that all
by JoeAltmaier 9y ago
And I'm saying, depends on how the model is built. If it is a simple dictionary then yes. But there are better ways to build a model. Its a naïve view that all models are like some strawman.
- nl 9y agoI don't understand what you are arguing. >>> the maximum-likelihood model is one where the frequency of every word is the frequency that you observed that word, and the frequency of unseen words is 0 >> I think that's false. A model may never reduce any probability to zero. Novel data is a normal feature of modelling. > But there are better ways to build a model. Yes of course there are. That's exactly what the OP said ("You correct it by being an intelligent human who knows the maximum-likelihood model is wrong, and applying a correction on top of it") but you seemed to be arguing against it. (And to be clear, there are also alternatives to the maximum likelihood model)