3 ms·
WizardMath[1] clearly has better benchmark results and they conveniently ignored it. They knew about the model because they have used their dataset. This has 5
by YetAnotherNick 3y ago
WizardMath[1] clearly has better benchmark results and they conveniently ignored it. They knew about the model because they have used their dataset.
This has 51.5% in GSM8K compared to 81.6% for WizardMath.
[1]: https://huggingface.co/WizardLM/WizardMath-70B-V1.0 https://huggingface.co/WizardLM/WizardMath-70B-V1.0
- joaogui1 3y agoOne of the main points of Llemma is being an open-source reproduction of Minerva, so basically that's the only comparison they "need" to make. Besides, isn't WizardMath trained on GPT-4 output? They may want to be comparing only among models that can be used commercially