3 ms·
There is a trivial way to avoid being scraped by a search engine robots.txt For facebook most of the time when it creates a screenshot to show next to the titl
by michaelmrose 6y ago
There is a trivial way to avoid being scraped by a search engine robots.txt
For facebook most of the time when it creates a screenshot to show next to the title in a share results in 1 or possibly many views driving revenue for the linked site for a small increase in bandwidth.
For example their site gets pulled once and read a dozen times.