4 ms·
There is ChatGLM[0], a 6 billion parameter Chinese/English bilingual model that is gaining a reputation as the leading locally runnable LLM for code generation.
by nathanasmith 4y ago
There is ChatGLM[0], a 6 billion parameter Chinese/English bilingual model that is gaining a reputation as the leading locally runnable LLM for code generation. Maybe look into that. Demo is here[1].
[0]https://github.com/THUDM/ChatGLM-6B/blob/main/README_en.md https://github.com/THUDM/ChatGLM-6B/blob/main/README_en.md
[1]https://huggingface.co/spaces/multimodalart/ChatGLM-6B https://huggingface.co/spaces/multimodalart/ChatGLM-6B
- nmfisher 4y agoI tried this the other day for generating basic Chinese conversations - the quality is surprisingly good. While it's still behind the latest GPT, but the gap isn't as large as I thought it would be.
- alchemist1e9 4y agoThis does seem promising when playing with the demo. That says running on a T4 I believe. This probably means we are only months away from viable self hosted code generation and analysis that could compete with gpt 3.5 turbo. It seems like working on locally runnable LLM that has been fine tuned to focus on code should be a high priority.