3 ms·
This is one of the best, most detailed write-ups of how to fine-train a large language model on custom text that I've seen anywhere.
by simonw 4y ago
This is one of the best, most detailed write-ups of how to fine-train a large language model on custom text that I've seen anywhere.
- izzymiller 4y agoThank you!! I felt it was getting so long and was worried it would be impenetrable, so I'm really pleased to hear it felt great.
- Tepix 4y agoReally great! With Alpaca-Lora 4-bit training getting usable any day now it should get a lot more affordable or you can even do it at home.
- xtracto 4y agoI agree. I've been looking to train/fine-tune an LLM model myself but the corpus I want to provide is not in question/answer mode. Is there a way to train or fine-tune an LLM model using say only plain text files?