3 ms·
I'm just here waiting for the "LLM retard guide" to come out, as it happened for stable diffusion last August.
by ByThyGrace 4y ago
I'm just here waiting for the "LLM retard guide" to come out, as it happened for stable diffusion last August.
- arthurcolle 4y agoLink to stable diffusion ref you're referring to? I was able to run the model and everything, so pretty familiar, but just wondering if you're referring to a specific document! Haha
- ByThyGrace 4y agoApparently this is the latest iteration: https://rentry.org/voldy https://rentry.org/voldy
- arthurcolle 4y agoLink is not working
- ByThyGrace 4y agoIt is working for me right now.
- throwaway4aday 4y agoCopy paste the parts of the install steps for LLaMA C++ into ChatGPT and ask it to explain things simply and include any prerequisite steps you might need to do. If you get stuck, just ask ChatGPT and include any error messages. https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp
- LoganDark 4y agoLLaMA C++ is easy to set up, but it's sort of slow even pegging all cores of an overclocked i5-12400F, so I'd like to get a 3060 working (with 12GB of VRAM)... it's just it's so difficult to get some sort of ChatGPT-style interface running. Haven't gotten anything working yet even though I have a working CUDA PyTorch. Bleh bleh bleh~
- LoganDark 4y agoOK, looks like the "LLM retard guide" is "run this installer": https://github.com/oobabooga/text-generation-webui/releases/tag/installers https://github.com/oobabooga/text-generation-webui/releases/... That's the only thing that worked for me, but it was so easy and worked instantly. It's a set of easily-auditable batch/bash scripts (depending on platform).