3 ms·
And is also not using an LLM. It's neural machine translation.
by reyqn 11mo ago
And is also not using an LLM. It's neural machine translation.
- superkuh 11mo agoNMT is a category containing both transformers and deep RNN. The Mozilla translation models are transformer LLM NMTs trained via Marian https://marian-nmt.github.io/ https://marian-nmt.github.io/ (ref: https://github.com/mozilla/translations/blob/main/docs/README.md#training-pipeline https://github.com/mozilla/translations/blob/main/docs/READM...)
- reyqn 11mo agoNMT doesn't "contain" tranformers and deep RNNs, it can use them. LLMs use a transformer architecture, not everything using a transformer architecture is an LLM. NMT can actually use an LLM, but that's not the case according to the documentation you linked, they use a parallel dataset to train their models.