Massively diverse community working on the AUTOMATIC1111 of textgen at https://github.com/oobabooga/text-generation-webui/ https://github.com/oobabooga/text-gen

Massively diverse community working on the AUTOMATIC1111 of textgen at https://github.com/oobabooga/text-generation-webui/ https://github.com/oobabooga/text-generation-webui/ Ooba's textgen webui runs LLaMA 4bit on 8GB VRAM consumer video cards. KoboldAI (https://github.com/henk717/KoboldAI/ https://github.com/henk717/KoboldAI/) by the creator the AI Horde of stable diffusion fame also supports LLaMA and has forked the Stable Horde for textgen. Currently horde is running half a dozen LLaMA models accessible at http://lite.koboldai.net/ http://lite.koboldai.net/