4 ms·
https://github.com/robots.txt https://github.com/robots.txt I don't see anything here about wiki specifically but maybe one of the rules hits wiki pages?
by beembeem 4y ago
https://github.com/robots.txt https://github.com/robots.txt
I don't see anything here about wiki specifically but maybe one of the rules hits wiki pages?
- crazysim 4y agoThey've moved from robots.txt to blocking by headers.