3 ms·Usually it's robots.txt that 'prohibits' such use, but you're right it's not enforceable.by wildrhythms 2y agoUsually it's robots.txt that 'prohibits' such use, but you're right it's not enforceable.