3 ms·
Ask HN: Are there “open” source AI translation models?
I'm interesting in translating some Japanese text into English.
I've used Google Translate, and it is tolerable, but not perfect. (Actually, it is mind boggling that this works at all, but the translations are not perfect, and that's fine).
I've used whisper from OpenAI to translate audio files from English to Japanese, and it is amazing. It picks up the colloquialisms in Japanese speech (Kansai-ben) when transcribing, and the translations are decent. So, it feels like there should be similar open models when I'm starting from text rather than providing audio data.
Is there a similar "open" source ML model for translation, similar to the Llama transformer model (and perhaps a project like llama.cpp) for text generation? I see lots and lots of APIs, but I'm not finding a model I can run on my own hardware. I realize open is an imprecise way to describe these models; I'm just looking for something I can run on my own private hardware and play with.