3 ms·Robots.txt is irrelevant after hiQ Labs v. LinkedIn (2019)by veggieroll 2y agoRobots.txt is irrelevant after hiQ Labs v. LinkedIn (2019)