5 ms·
I use Llama 3.1 8B Instruct 128k at home and that pretty much covers all my LLM needs. Don't see a reason to pay for GPT-4.
by changing1999 2y ago
I use Llama 3.1 8B Instruct 128k at home and that pretty much covers all my LLM needs. Don't see a reason to pay for GPT-4.
- wkat4242 2y agoYeah it's good, right?? Amazingly good. The first-gen small models were a bit iffy but Llama 3.1 is so good <3 The only thing I see is that it hallucinates a lot when you ask it for knowledge. Which makes sense because 8B is just not a lot to keep detailed information around. But the ability to recite training knowledge is really a misuse of LLMs and only a peculiar side-effect. I combine it with google searches (though OpenWebUI and SearXNG) and it works amazingly well then.
- changing1999 2y agoOh this is great! Currently I don't incorporate web search into the UI I use, will give OpenWebUI a try.
- fennecfoxy 2y agoYeah, and realistically once we can get hardware powerful but cheap/energy efficient enough to run llm + TTS + ASR without any noticeable delay during a conversation then who needs cloud services for most stuff. The really big models will still be useful, but really only for specific things.