3 ms·
Is there something for the opposite? I don't want google (or any other scrapper) to index my website. Afaik, robots.txt is not authoritative.
by dakiol 3y ago
Is there something for the opposite? I don't want google (or any other scrapper) to index my website. Afaik, robots.txt is not authoritative.
- speedgoose 3y agosudo iptables -A INPUT -p tcp --dport 80 -j DROP sudo iptables -A INPUT -p tcp --dport 443 -j DROP sudo ip6tables -A INPUT -p tcp --dport 80 -j DROP sudo ip6tables -A INPUT -p tcp --dport 443 -j DROP That should do.