4 ms·
An easy way to try many of the fine-tuned Llama 2 models is https://github.com/jmorganca/ollama https://github.com/jmorganca/ollama. A maintainer of the projec
by jmorgan 3y ago
An easy way to try many of the fine-tuned Llama 2 models is https://github.com/jmorganca/ollama https://github.com/jmorganca/ollama.
A maintainer of the project has been collecting a full list here (with different quantization levels), most of which are Llama 2-based: https://gist.github.com/mchiang0610/b959e3c189ec1e948e4f6a1f737a1fc5 https://gist.github.com/mchiang0610/b959e3c189ec1e948e4f6a1f...
Since the release of Llama 2 the number of models based on it has been growing significantly.. some popular ones:
- codeup (A code generation model - DeepSE)
- llama2-uncensored (George Sung)
- nous-hermes-llama2 (Nous Research)
- wizardlm-uncensored (WizardLM)
- stablebeluga (Stability AI)
The article also recommends oobabooga's text-generation-webui which includes a full web dashboard.
- xcdzvyn 3y agoWow, thanks! I really like Ollama, so I'm glad the models listed at the top of the Readme aren't all you could use. Do you know where the data in that Gist came from? Is there a registry somewhere?
- jmorgan 3y agoThere is! While not easy to use yet, there's a sort-of-hidden way models can be listed with: curl https://ollama.ai/v2/_catalog | jq Then to list "tags" for a given model (e.g. llama2): curl https://ollama.ai/v2/library/llama2/tags/list | jq
- xcdzvyn 3y agoOh, you're the maintainer! Hahaha my bad. Thanks :)
- danielbln 3y agollama2-uncensored is a lot of fun, interacting with an unaligned/uncensored model feels very fresh.