One of the performance checks they use is how quickly the body text renders into a readable format as a page loads. If your site has slow loading web fonts, AND

One of the performance checks they use is how quickly the body text renders into a readable format as a page loads. If your site has slow loading web fonts, AND you haven't specified a fall-back font (i.e. serif, or sans-serif etc.), Google will penalise it.