3 ms·
Ask HN: Are there any LLMs specialised in translating Japanese to English?
I'm interested in LLM that I could spin up locally and that gives decent translation results for hiragana/katakana only text. I'm trying to play old Japanese video games using a text hooker, and not having kanji makes translations often incorrect and, in very rare cases, just funny. If translation could be influenced by "setting a scene" before translating, that could be even better.
- brucethemoose2 3y agoTry llama v1 13B with https://huggingface.co/izumi-lab/llama-13b-japanese-lora-v0-1ep https://huggingface.co/izumi-lab/llama-13b-japanese-lora-v0-... There may be even larger llama tunes for Japanese... But huggingface is tricky to search. I would suggest baking the LORA into a ggml file and then running it with koboldcpp (with opencl offloading) for maximum ease of use. https://github.com/LostRuins/koboldcpp https://github.com/LostRuins/koboldcpp You could get even better results using Japanese llama.cpp grammar, but I have not been down that rabbit hole: https://github.com/ggerganov/llama.cpp/pull/1773 https://github.com/ggerganov/llama.cpp/pull/1773