3 ms·
robots.txt is like a UN strongly worded letter Bad actors have ignored them from the start, and are good enough at faking headers/using multiple ips such that
by TylerE 4y ago
robots.txt is like a UN strongly worded letter
Bad actors have ignored them from the start, and are good enough at faking headers/using multiple ips such that they are very difficult to block
- shadowgovt 4y agoTrue. I was still speaking of the polite space and what the protocol can offer. In the impolite space, these problems are addressed by encryption and auth/auth, not polite protocol. Which defeats much of Mastodon's designed goal IIUC.