2 ms·
So is Llama3 the best right now for programming-related inquiries? Say, making my Elixir code adhere to OTP principles.
by johnisgood 2y ago
So is Llama3 the best right now for programming-related inquiries? Say, making my Elixir code adhere to OTP principles.
- OutOfHere 2y agoLlama3 still is worse than GPT4 for programming, but I expect this gap to be eliminated as newer versions of Llama keep coming. https://openlm.ai/coder-evalplus/ https://openlm.ai/coder-evalplus/ says that CodeQwen1.5-7B-Chat is the best open model for coding. https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard https://huggingface.co/spaces/open-llm-leaderboard/open_llm_... lists davidkim205/Rhea-72b-v0.5 as the best open model overall. https://leaderboard.tabbyml.com/ https://leaderboard.tabbyml.com/ lists DeepSeekCoder-6.7B as the best for coding. The takeaway is that Llama 3 looks a lot better than Llama 2, and I expect this trend to continue to 4 and 5, to the point where 5 could overtake GPT4.