3 ms·
Would a robots.txt-equivalent solution satisfy both parties? Media orgs could ban the indexing of their pages by specific scrapers, and users on those social n
by lxm 4y ago
Would a robots.txt-equivalent solution satisfy both parties?
Media orgs could ban the indexing of their pages by specific scrapers, and users on those social networks would just see a raw URL, not a preview with headline+image+blurb?