4 ms·
It is running a full transformer type neural network on your cpu, it needs all the speed it can get. It’s because the translation engine requires at least SSSE
by jelmervdl 4y ago
It is running a full transformer type neural network on your cpu, it needs all the speed it can get.
It’s because the translation engine requires at least SSSE3.1 instructions[1]. These are translated to wasm SIMD instructions[2] which are only enabled by browsers if the underlying hardware is there to execute these at least somewhat efficient.
[1] https://github.com/browsermt/bergamot-translator/issues/418 https://github.com/browsermt/bergamot-translator/issues/418
[2] https://emscripten.org/docs/porting/simd.html https://emscripten.org/docs/porting/simd.html