I really want to use llama3 8B Q4_0 llama.cpp for some fun automation tasks so I tried following this guide: https://voorloopnul.com/blog/quantize-and-run-the-o

I really want to use llama3 8B Q4_0 llama.cpp for some fun automation tasks so I tried following this guide: https://voorloopnul.com/blog/quantize-and-run-the-original-llama3-8b-with-llama-cpp/ https://voorloopnul.com/blog/quantize-and-run-the-original-l... but all I get out of it is rambling nonsense. Glad ollama exists I guess, running that works fine for me.