3 ms·
GPT-4 report has MMLU score, which is believed to one of the most important metric for question answering task. GPT-4 MMLU score is slightly higher than PaLM 2(
by YetAnotherNick 3y ago
GPT-4 report has MMLU score, which is believed to one of the most important metric for question answering task. GPT-4 MMLU score is slightly higher than PaLM 2(86 vs 81). Google didn't compare it in with PaLM 2 in this paper.
- in3d 3y ago86 vs 81 is not slightly higher. It’s 26% fewer wrong answer.