5 ms·
At minimum, use robots to keep crawlers out of these sites. Or you're going to be getting letters. Cloning people's content in ways google finds isn't cool.
by x0x0 8y ago
At minimum, use robots to keep crawlers out of these sites. Or you're going to be getting letters. Cloning people's content in ways google finds isn't cool.
- rado 8y agoThank you, adding rule to robots.txt. Regards