4 ms·
What LLM is this using? Or did you train your own?
by akrymski 4y ago
What LLM is this using? Or did you train your own?
- wsxiaoys 4y agoTabby is tested against various open-source models based on GPT-J/GPT-NeoX, including https://huggingface.co/CarperAI/FIM-NeoX-1.3B https://huggingface.co/CarperAI/FIM-NeoX-1.3B and https://huggingface.co/Salesforce/codegen-350M-multi https://huggingface.co/Salesforce/codegen-350M-multi. In the meantime, I'm training language-specific base models using NeoX blocks. I hope to release them soon. The Huggingface Space demo is running on a derived model of Salesforce/codegen-350M-multi