4 ms·

Does anyone have any feedback on using those open-source models with any language except English? Particularly non-western group of languages like korean/japane

Does anyone have any feedback on using those open-source models with any language except English? Particularly non-western group of languages like korean/japanese/chinese? Will assess myself but wonder if anyone tried.

3Sophons 3y ago
For Chinese, there are this Yi Model by 0.1 AI Yi 34B https://www.secondstate.io/articles/yi-34b/ https://www.secondstate.io/articles/yi-34b/ Uncencored Yi: https://www.secondstate.io/articles/dolphin-2.2-yi-34b/ https://www.secondstate.io/articles/dolphin-2.2-yi-34b/ and also Baichuan https://www.secondstate.io/articles/baichuan2-13b-chat/ https://www.secondstate.io/articles/baichuan2-13b-chat/ There is an Arabic one called Jais mentioned by Satya a few days ago on the Microsoft dev day would like to try out
- wahnfrieden 3y ago
  Yi has weird license
  - 3Sophons 3y ago
    emmm do you mean not truly open source
    - wahnfrieden 3y ago
      You must send them an email to get commercial use permission. It does not look like a lawyer wrote their license either
      - 3Sophons 3y ago
        I think you have to do similar things with Baichuan too. Which is also a bit pseudo open source
nmfisher 3y ago
Alibaba's Qwen is excellent for Chinese.
- 3Sophons 3y ago
  For Qwen there is this the CausualLM 14B model, based on llama2 architecture but with Qwen 14B model weights.
  - nmfisher 3y ago
    Oh thanks, I didn't know about that. Will check it out!
    - 3Sophons 3y ago
      https://www.secondstate.io/articles/causallm-14b/ https://www.secondstate.io/articles/causallm-14b/
clarionbell 3y ago
They work, but they need way more tokens to express themselves. Still, it beats paying OpenAI for the privilege.
numpad0 3y ago
It's probably better to switch to suitable language-specific models. GPTs sound translated in non-native languages, and also has difficulty separating CJK due to that Unicode quirk.
axegon_ 3y ago
A bit of a hit and miss really. I haven't fiddled with languages all that much, but I was kinda curious to try a bunch of models with Spanish(the only large language other than English in my toolbox) about a month or two ago. Aguila 7B was the one that really stood out but then again it shouldn't come as a surprise - it is practically Falcon 7B trained on Spanish data.

3Sophons 3y ago

For Chinese, there are this Yi Model by 0.1 AI Yi 34B https://www.secondstate.io/articles/yi-34b/ https://www.secondstate.io/articles/yi-34b/ Uncencored Yi: https://www.secondstate.io/articles/dolphin-2.2-yi-34b/ https://www.secondstate.io/articles/dolphin-2.2-yi-34b/ and also Baichuan https://www.secondstate.io/articles/baichuan2-13b-chat/ https://www.secondstate.io/articles/baichuan2-13b-chat/ There is an Arabic one called Jais mentioned by Satya a few days ago on the Microsoft dev day would like to try out

wahnfrieden 3y ago
Yi has weird license
- 3Sophons 3y ago
  emmm do you mean not truly open source
  - wahnfrieden 3y ago
    You must send them an email to get commercial use permission. It does not look like a lawyer wrote their license either
    - 3Sophons 3y ago
      I think you have to do similar things with Baichuan too. Which is also a bit pseudo open source

nmfisher 3y ago

Alibaba's Qwen is excellent for Chinese.

3Sophons 3y ago
For Qwen there is this the CausualLM 14B model, based on llama2 architecture but with Qwen 14B model weights.
- nmfisher 3y ago
  Oh thanks, I didn't know about that. Will check it out!
  - 3Sophons 3y ago
    https://www.secondstate.io/articles/causallm-14b/ https://www.secondstate.io/articles/causallm-14b/

clarionbell 3y ago

They work, but they need way more tokens to express themselves. Still, it beats paying OpenAI for the privilege.

numpad0 3y ago

It's probably better to switch to suitable language-specific models. GPTs sound translated in non-native languages, and also has difficulty separating CJK due to that Unicode quirk.

axegon_ 3y ago

A bit of a hit and miss really. I haven't fiddled with languages all that much, but I was kinda curious to try a bunch of models with Spanish(the only large language other than English in my toolbox) about a month or two ago. Aguila 7B was the one that really stood out but then again it shouldn't come as a surprise - it is practically Falcon 7B trained on Spanish data.