Wouldn't help in this case, the post author banned the bot in the robots for, but then when asked the bot to fetch his web page explicitly by URL... If a user

Wouldn't help in this case, the post author banned the bot in the robots for, but then when asked the bot to fetch his web page explicitly by URL... If a user has a bot directly acting on their behalf (not for training), I think that's fair use... And important to think twice before we block that, since it will be used for accessibility.