3 ms·
Open Source Chinese LLMs
- kvathupo 3y agoWanted to share since I haven't seen much discussion of LLM development in China other than Baidu-Wenxin (at least in US media). Sharing this particular one since it's open-source and apparently started by an undergrad [1]! That said, it seems to fine-tune atop [2] (a pre-trained LLM on Chinese characters). Some other open-source Chinese LLMs I stumbled upon are [3] and [4]. [1] - https://qiyuan-chen.github.io/ https://qiyuan-chen.github.io/ [2] - https://github.com/THUDM/ChatGLM-6B/blob/main/README_en.md https://github.com/THUDM/ChatGLM-6B/blob/main/README_en.md [3] - https://github.com/LianjiaTech/BELLE https://github.com/LianjiaTech/BELLE [4] - https://github.com/ymcui/Chinese-LLaMA-Alpaca/blob/main/README_EN.md https://github.com/ymcui/Chinese-LLaMA-Alpaca/blob/main/READ...