4 ms·
Llama3 still is worse than GPT4 for programming, but I expect this gap to be eliminated as newer versions of Llama keep coming. https://openlm.ai/coder-evalplu
by OutOfHere 2y ago
Llama3 still is worse than GPT4 for programming, but I expect this gap to be eliminated as newer versions of Llama keep coming.
https://openlm.ai/coder-evalplus/ https://openlm.ai/coder-evalplus/ says that CodeQwen1.5-7B-Chat is the best open model for coding.
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard https://huggingface.co/spaces/open-llm-leaderboard/open_llm_... lists davidkim205/Rhea-72b-v0.5 as the best open model overall.
https://leaderboard.tabbyml.com/ https://leaderboard.tabbyml.com/ lists DeepSeekCoder-6.7B as the best for coding.
The takeaway is that Llama 3 looks a lot better than Llama 2, and I expect this trend to continue to 4 and 5, to the point where 5 could overtake GPT4.