3 ms·
Does it support anything other than English? Sadly, most open-weights models have no support for languages other than English, which makes them useless for 75%
by kgeist 2y ago
Does it support anything other than English? Sadly, most open-weights models have no support for languages other than English, which makes them useless for 75% world's population who don't speak English at all.
Does anyone know of a good lightweight open-weights LLM which supports at least a few major languages (let's say, the official UN languages at least)?
- EugeneOZ 2y ago> SmolLM2 models primarily understand and generate content in English. https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct/blob/main/README.md https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct/b...
- Gathering6678 2y agoI occasionally use the 1.5B and 3B version of Qwen2.5 for translation between English, Chinese and Japanese, of which they seem to do a good job.
- nmstoker 2y agoGood point raising just how many don't speak any English. That sounds like a lot of people who could do something to produce/ contribute to a non-English language language model.
- LoganDark 2y ago> Does anyone know of a good lightweight open-weights LLM which supports at least a few major languages (let's say, the official UN languages at least)? RWKV World exists (100+ languages on purpose), though it's a bit different from traditional LLMs so YMMV.