3 ms·
text-generation-webui (https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui)
by nickthegreek 4y ago
text-generation-webui (https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui)
- kolinko 4y agoI tried it, but I can't find the right model for llama+lora 30B . Google, nor Bing ;) is not helpful.
- nickthegreek 4y agoI think this is the one you want: https://huggingface.co/elinas/alpaca-30b-lora-int4 https://huggingface.co/elinas/alpaca-30b-lora-int4