3 ms·
There are tons of models that either LoRA or finetune LLaMA, but I meant foundational models, i.e., ones completely distinct from LLaMA. That includes Falcon,
by ozr 3y ago
There are tons of models that either LoRA or finetune LLaMA, but I meant foundational models, i.e., ones completely distinct from LLaMA. That includes Falcon, MPT, StableLM, StarCoder, Replit Code, CodeGen.
There's also RedPajama and OpenLLaMA, which are intended to give similar performance to LLaMA but be legally distinct.