That graphic comparing benchmark averages is really nice, wish things were presented so clearly more often. That being said, I think this definitely tilts thin

That graphic comparing benchmark averages is really nice, wish things were presented so clearly more often. That being said, I think this definitely tilts things in Molmo's favor by including so many benchmarks that seem to favor Molmo, in particular the counting ones. The average hides that it has a pretty modest MMLU score compared to state of the art.