5 ms·
> What absolutely does not work is trying to just feed a set of documents into fine tuning. Not quite. It does work, albeit likely not optimal. See https://gi
by stevenhuang 3y ago
> What absolutely does not work is trying to just feed a set of documents into fine tuning.
Not quite. It does work, albeit likely not optimal.
See https://github.com/bublint/ue5-llama-lora https://github.com/bublint/ue5-llama-lora
- ilaksh 3y agoHave you tried that? I find the results hard to believe because he says he is using Llama 7b and asking it questions but that is not a chat model. Also he does not appear at all in the issues when people ask him about reproducing the results. Instead there are people in the issues recommending RAG or creating a QA dataset.