3 ms·
Don't most of them have llama as their origin/basis? Which ones are independent completely?
by r00fus 3y ago
Don't most of them have llama as their origin/basis? Which ones are independent completely?
- ozr 3y agoThere are tons of models that either LoRA or finetune LLaMA, but I meant foundational models, i.e., ones completely distinct from LLaMA. That includes Falcon, MPT, StableLM, StarCoder, Replit Code, CodeGen. There's also RedPajama and OpenLLaMA, which are intended to give similar performance to LLaMA but be legally distinct.