4 ms·The tool came up with it's own solution to an already solved problem. It should respect robots.txtby adultSwim 3y agoThe tool came up with it's own solution to an already solved problem. It should respect robots.txt