3 ms·
I didn't know model merging like that was possible. (Obviously possible from a pure software standpoint but I'm surprised it's effective)
by DonsDiscountGas 4mo ago
I didn't know model merging like that was possible. (Obviously possible from a pure software standpoint but I'm surprised it's effective)
- bwhitty 4mo agoAs another poster above linked, it’s been shown to be effective since 2022: https://arxiv.org/abs/2203.05482 https://arxiv.org/abs/2203.05482
- nightpool 4mo agoit works because Nex N2 is also a derivative of the original base Qwen model. If it was two completely unrelated models it wouldn't work.
- hypercube33 4mo agoEven merging models with themselves as shown here in the post how they got to the top of hugging face with two gpus
- baobabKoodaa 4mo agoA few years back these used to be called "Frankenstein models"