4 ms·
Since robots.txt is currently ignored by bad actors, why would any alternative be better?
by dazc 3y ago
Since robots.txt is currently ignored by bad actors, why would any alternative be better?
- tjpnz 3y agoBecause Google can start ripping off content in the open with impunity.
- berkle4455 3y ago> bad actors I prefer the term ‘Chad third-party scraper’ [1] https://pbs.twimg.com/media/FxkeJmjakAENFI8?format=jpg&name=900x900 https://pbs.twimg.com/media/FxkeJmjakAENFI8?format=jpg&name=...