4 ms·
I don't know, maybe I'm desensitized by GPT4 but I'm running Llama2 70B and I certainly wouldn't call it 'disturbingly good'.
by zacmps 3y ago
I don't know, maybe I'm desensitized by GPT4 but I'm running Llama2 70B and I certainly wouldn't call it 'disturbingly good'.
- brucethemoose2 3y agoBase Llama is not good at all, but the finetunes are quite good at their niches. Llama in general is not great for code completion and fact retrieval, from what I have tried
- thewataccount 3y agoCheck out the hugging face leader board and try one of the finetunes. I can't run llama2 70B - but I remember llama1-Guanaco30B was a major leap over the base llama30B model for me.
- zacmps 3y agoThanks! That's useful to know. Unfortunately it looks like a lot of them are non-commercial which rules them out for me but there's a couple that look like they might work.
- brucethemoose2 3y agoIts rather outdated. Search for "70b" on huggingface, sort by date, and you will find more cutting edge models. And you can run this locally with enough combined RAM + VRAM.