4 ms·
I'm still new to LoRA/fine tunes, but: I can't just dump in 1gb of data, correct? I need to structure it in Question/Answer or the like? So it would seem the c
by voiper1 2y ago
I'm still new to LoRA/fine tunes, but: I can't just dump in 1gb of data, correct?
I need to structure it in Question/Answer or the like?
So it would seem the cost really becomes converting/curating the data into a usable format first.
- staticman2 2y agoYou can dump in 1gb of data (Unsloth supports "raw text training") but whether you'd get good results or a useless model is a different issue. I doubt you'd get a good result unless you combine that with question/answer training as well, assuming that feature is even useful at all for your scenario.