The most relevant reported benchmark results are on https://arxiv.org/abs/2103.03874 https://arxiv.org/abs/2103.03874 They compare it against PaLM and Minerva,

The most relevant reported benchmark results are on https://arxiv.org/abs/2103.03874 https://arxiv.org/abs/2103.03874 They compare it against PaLM and Minerva, both of which are fine tuned on math datasets. It outperforms both at roughly the same parameter count (eg Llama 65B vs Palm and Minerva 62B) but unclear how much of this is due to encoding vs the many other differences. It is useful to see that the performance increase is clearly not due to fine turning though.