Quite the contrary: the news stands would have the front page displayed quite prominently precisely so that you could read the headlines of the main stories to

Quite the contrary: the news stands would have the front page displayed quite prominently precisely so that you could read the headlines of the main stories to attract the interest of passerbys: https://p.turbosquid.com/ts-thumb/0m/ePJxnz/tlmgVado/news_stands_12/jpg/1204569666/1920x1080/fit_q99/f7f118ff235e678685ed0f329d2c415bc01ebd7a/news_stands_12.jpg https://p.turbosquid.com/ts-thumb/0m/ePJxnz/tlmgVado/news_st... If outlets don't want the headlines scraped and displayed, then they're free to modify their `robots.txt` file accordingly. But they don't because they're well aware that this would reduce, not improve, their bottom line.