Yes, there's often not much reason to block bots that abide by the rules. It just makes your site not show up on other search indexes and introduces problems fo

Yes, there's often not much reason to block bots that abide by the rules. It just makes your site not show up on other search indexes and introduces problems for users. Malicious bots won't care about your robots.txt anyway.