4 ms·
All language models attempt to model what word is more likely in a given context :) What is somewhat unusual about this approach is they use recurrent neural n
by gok 10y ago
All language models attempt to model what word is more likely in a given context :)
What is somewhat unusual about this approach is they use recurrent neural networks for the language modeling, as opposed to more traditional approached like a backoff n-gram model.
- nl 10y agoMost modern language modelling is RNN based now; eg: https://arxiv.org/abs/1602.02410 https://arxiv.org/abs/1602.02410 (which I think is SOTA).