4 ms·
> Why would I ever let bing crawl my site if they aren't going to send any visitors to me? How can you refuse? The only way I know would be to require an acco
by bioemerl 4y ago
> Why would I ever let bing crawl my site if they aren't going to send any visitors to me?
How can you refuse? The only way I know would be to require an account, but even then they could bypass it.
- rafale 4y agoMajor search engines honor robots.txt
- bioemerl 4y agoIf it becomes standard to have such a file and it effects their bottom line, could they disregard it?
- Xelynega 4y agoIf the file that were previously honored as consent to use the copyright material is subsequently ignored, wouldn't the content creators take the indexers to court for copyright infringement?