3 ms·
mergekit is the tool you need to do this https://github.com/cg123/mergekit you can slice off layers and blend models with different strategies.
by denimboy 3y ago
mergekit is the tool you need to do this
https://github.com/cg123/mergekit
you can slice off layers and blend models with different strategies.
- brucethemoose2 3y agoMergekit is the best thing since sliced bread, as the local llm community already knows. The dev's blog is great: https://goddard.blog/posts/ https://goddard.blog/posts/ ...But its not what this paper is describing. They are basically alternating models, AFAIK. Also I have other nitpicks with the paper, like using extremely old/mediocre chat models as bases: > Pygmillion 6B, Vicuna 13B, Chai Model 6B