2 ms·
All (?) the "open" (to various degrees of openness) LLMs are on HuggingFace and have code to support their unique options. For example here is Llama[1] and here
by nl 4y ago
All (?) the "open" (to various degrees of openness) LLMs are on HuggingFace and have code to support their unique options. For example here is Llama[1] and here is Opt[2].
All the code I've seen for training them uses Hugging Face. When EleutherAI releases their open foundation LLM then everyone will want to fine tune it and do RLHF on it and they'll all use HuggingFace code to do it.
I think they are in the best position of any company including OpenAI.
[1] https://huggingface.co/docs/transformers/main/model_doc/llama https://huggingface.co/docs/transformers/main/model_doc/llam...
[2] https://huggingface.co/docs/transformers/main/model_doc/opt https://huggingface.co/docs/transformers/main/model_doc/opt
- kiratp 4y agoThey are at high risk of becoming another Docker. Everyone uses it but nobody pays for it.
- visarga 4y agoThey might succeed if they can convince people to subscribe for model updates like we do for security patches and game updates. For example release any new model for paying members in the first 30 days, and for everyone else later. Or some kind of paid API for LLMs, like "Open"AI, because it's too much of a hassle to run your own LLM.