3 ms·
Them being very tailored to the main model is true, and it takes a lot of work for the lora author to target multiple base models, so they generally just target
by Tostino 3y ago
Them being very tailored to the main model is true, and it takes a lot of work for the lora author to target multiple base models, so they generally just target one.
I plan on releasing my next iteration of my model (trained on generating knowledge graphs, among other things) as both a lora, and a pre-merged model for multiple base models (Mistral 7b, Llama2 13b, Phi2 2.7b, Yi 34b, and possibly Mixtral)
Will be interesting to compare the results between them, considering last time I just did Llama2 13b. Can't wait to see the improvements in the base models since then.
- hyperliner 3y ago[dead]