can you substantiate "works significantly worse"? because obviously JG and whoever else worked on the BERT upgrade would disagree, but i am genuinely interested

can you substantiate "works significantly worse"? because obviously JG and whoever else worked on the BERT upgrade would disagree, but i am genuinely interested in contrarian takes.