3 ms·
I think a huge part is that computational linguistics still chases the idea of a universal language model, which may simply not be possible. I haven't followed
by hnbad 4y ago
I think a huge part is that computational linguistics still chases the idea of a universal language model, which may simply not be possible. I haven't followed the science in general linguistics but something feels off when most of the information ends up being tagged onto nil particles (i.e. parts of speech present neither in utterances nor written language and not affecting intonation or otherwise being detectable except by contrasting the structure with related languages).
- hnfong 4y agoIn a sense the model is universal. It's just a 100GB (give or take) neural network. And apparently (or so I heard, I think) feeding transformer models training data of Language A could improve its ability to understand Language B. So maybe there's something truly universal in some sense.