3 ms·

Do you know what the pipeline looks like for new language pairs being added? This is really, really, really awesome I'm also immediately curious about using it

• jelmervdl 4y ago
  The training pipeline is also on Github! [1] I was experimenting with running the wasm version of bergamot-translator (the translation engine used by the addon) in node [2]. However, if you want more performance, using the Python library [3] or the native C++ interface [4] gets you further because the wasm build is limited to a single thread and thus a blocking interface, and can't use all the processor specific optimisations that are in the native builds. EDIT: Another option is using translateLocally [5], which is a Qt desktop app based on bergamot-translator. It has a native messaging API that is designed as a much faster alternative to the wasm build for browser extensions, but it can also be used from Python [6]. [1] https://github.com/mozilla/firefox-translations-training https://github.com/mozilla/firefox-translations-training [2] https://gist.github.com/jelmervdl/a4c8b6b92ad88a885e1cbd51c6ad4902 https://gist.github.com/jelmervdl/a4c8b6b92ad88a885e1cbd51c6... [3] https://colab.research.google.com/drive/1AHpgewVJBFaupwAbZq0e6TdX6REx0Ul0?usp=sharing https://colab.research.google.com/drive/1AHpgewVJBFaupwAbZq0... [4] https://github.com/browsermt/bergamot-translator/blob/main/app/bergamot.cpp https://github.com/browsermt/bergamot-translator/blob/main/a... [5] https://github.com/XapaJIaMnu/translateLocally https://github.com/XapaJIaMnu/translateLocally [6] https://github.com/XapaJIaMnu/translateLocally/blob/master/scripts/native_client.py https://github.com/XapaJIaMnu/translateLocally/blob/master/s...