3 ms·
NMT is a category containing both transformers and deep RNN. The Mozilla translation models are transformer LLM NMTs trained via Marian https://marian-nmt.githu
by superkuh 1y ago
NMT is a category containing both transformers and deep RNN. The Mozilla translation models are transformer LLM NMTs trained via Marian https://marian-nmt.github.io/ https://marian-nmt.github.io/ (ref: https://github.com/mozilla/translations/blob/main/docs/README.md#training-pipeline https://github.com/mozilla/translations/blob/main/docs/READM...)
- reyqn 1y agoNMT doesn't "contain" tranformers and deep RNNs, it can use them. LLMs use a transformer architecture, not everything using a transformer architecture is an LLM. NMT can actually use an LLM, but that's not the case according to the documentation you linked, they use a parallel dataset to train their models.