3 ms·
Have you seen LoRA adapters actually work for this kind of thing? The leaked Google "We have no moat" memo was very excited about LoRA style techniques, but it
by simonw 3y ago
Have you seen LoRA adapters actually work for this kind of thing?
The leaked Google "We have no moat" memo was very excited about LoRA style techniques, but it's not clear to me that it's been proven as a technique yet.
- eurekin 3y agoNo, I have tried about 3 times and all failed. Altough it might be that I'm simply doing it wrong. There are people (can point at a discord server) claiming it works for them and that they even sell finetuned models to business clients. EDIT: I found one of the articles I tried to follow: https://www.mlexpert.io/prompt-engineering/chatbot-with-local-llm-using-langchain https://www.mlexpert.io/prompt-engineering/chatbot-with-loca... EDIT2: Ignore above. This seemed much more promising: https://www.youtube.com/watch?v=pnwVz64jNvw https://www.youtube.com/watch?v=pnwVz64jNvw . Author provides consulting services and seemed very nice and approachable