4 ms·
LLaMA2 is far and away from GPT 3.5. Just look at HumanEval and other code generation metrics. All these GPT-4 based "chat evals" are extremely misleading and p
by sytelus 3y ago
LLaMA2 is far and away from GPT 3.5. Just look at HumanEval and other code generation metrics. All these GPT-4 based "chat evals" are extremely misleading and people should take it with a bag of salt.
- alecco 3y agoThat's what I say in my comment, OP's ranking is quite misleading. The ranking I linked and quoted in my comment's is much better. See the About tab. It has 4 evaluations and it doesn't use GPT-4 to evaluate. Also the top one is a tuned Llama 2. Also clarified in my original comment.
- swyx 3y agomany usecases that arent code, + people can finetune llama2 with code. its a great start for a free model.