3 ms·
Unfortunately the Arena is missing some of the strongest "open" models, such as WizardLM Uncensored 30B. In fact they don't have any Llama 30B/65B based models,
by redox99 3y ago
Unfortunately the Arena is missing some of the strongest "open" models, such as WizardLM Uncensored 30B. In fact they don't have any Llama 30B/65B based models, just 13B models.
- PostOnce 3y agoYes, considering GPT models are huge, they should probably compare them against the huge local models (as well as the 13B ones which are shockingly close).
- mrtranscendence 3y agoAre there metrics for WizardLM Uncensored? I can’t find anything showing it to be a strong contender, and it seems like the primary focus of its training was to remove censoring, which seems orthogonal to high performance.
- redox99 3y agoMaybe there are some small tests (GPT4 comparing it to other contenders), but it's mostly other people's experience trying a lot of these models. Also it being 30B makes it already quite stronger than those in the leaderboard. And by the way, the censoring does seem to hurt the performance a bit. Edit: Here are some scores https://www.reddit.com/r/LocalLLaMA/comments/13shhgf/gotzmann_llm_score/ https://www.reddit.com/r/LocalLLaMA/comments/13shhgf/gotzman...