2 ms·
Any tips on setting up llama+lora on 30b? There are so many resources that I can't figure out which models to use, and which projects to use to set everything u
by kolinko 4y ago
Any tips on setting up llama+lora on 30b? There are so many resources that I can't figure out which models to use, and which projects to use to set everything up.
- nickthegreek 4y agotext-generation-webui (https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui)
- kolinko 4y agoI tried it, but I can't find the right model for llama+lora 30B . Google, nor Bing ;) is not helpful.
- nickthegreek 4y agoI think this is the one you want: https://huggingface.co/elinas/alpaca-30b-lora-int4 https://huggingface.co/elinas/alpaca-30b-lora-int4