You dont need the visitors to know how to do it, only newspapers’ devs or any kind of tech. Someone must be responsible for maintaining their websites, and robo

You dont need the visitors to know how to do it, only newspapers’ devs or any kind of tech. Someone must be responsible for maintaining their websites, and robots.txt is as simple as can be, even has plugins for cms and such. Websites can opt out but most of those make their money by driving traffic off of search engines and social media and selling ads themselves. Only the best of the best media sites would even make it online without traffic from aggregators and social media (i have been involved in local media so yes, that is from experience). However, either case, media sites lose more than Google or fb gains if they delist, gands down.