5 ms·If the bots respected robots.txt, I would not have a viable business plan.by xena 6mo agoIf the bots respected robots.txt, I would not have a viable business plan.