I once read it's about bandwidth. Presumably, search engines require lots of BW to serve, and some sites don't want this cost. They make an exception for Google

I once read it's about bandwidth. Presumably, search engines require lots of BW to serve, and some sites don't want this cost. They make an exception for Google because they want to be on Google.