2 ms·
Well, a language model is supposed to model the way that language works, not the way that language is used. It might be a subtle difference, but "My mom is a d
by YeGoblynQueenne 7y ago
Well, a language model is supposed to model the way that language works, not the way that language is used.
It might be a subtle difference, but "My mom is a doctor" is as correct grammatically as "My dad is a doctor". If a language model is assigning a much lower probability to the former, then it's modelling language _use_ but not language _structure_.
So it's not doing the job it's supposed to be doing.