Try llama v1 13B with https://huggingface.co/izumi-lab/llama-13b-japanese-lora-v0-1ep https://huggingface.co/izumi-lab/llama-13b-japanese-lora-v0-... There may

Try llama v1 13B with https://huggingface.co/izumi-lab/llama-13b-japanese-lora-v0-1ep https://huggingface.co/izumi-lab/llama-13b-japanese-lora-v0-... There may be even larger llama tunes for Japanese... But huggingface is tricky to search. I would suggest baking the LORA into a ggml file and then running it with koboldcpp (with opencl offloading) for maximum ease of use. https://github.com/LostRuins/koboldcpp https://github.com/LostRuins/koboldcpp You could get even better results using Japanese llama.cpp grammar, but I have not been down that rabbit hole: https://github.com/ggerganov/llama.cpp/pull/1773 https://github.com/ggerganov/llama.cpp/pull/1773