> He basically said that they have a responsibility to drive users to sites with click through or else sites won't have an incentive to be crawled. This is par

> He basically said that they have a responsibility to drive users to sites with click through or else sites won't have an incentive to be crawled. This is partially a BS answer. As long as websites are running Google Ads, they will have an incentive to be crawled. Fewer clicks > no clicks (which is what would happen if the site was set to 'noindex'. Google also pays news publishers to license their content; $1bn alone just for Google News Showcase [0] [0] https://blog.google/supportingnews/#overview https://blog.google/supportingnews/#overview