3 ms·No robots.txt is unpredictable because it depends on the implementation of the bot.by vertis 4y agoNo robots.txt is unpredictable because it depends on the implementation of the bot.