3 ms·
It may do. I remember looking into it and not getting a definitive answer. The issue here is that taking a site offline has surely been widely understood as the
by bluebarbet 1y ago
It may do. I remember looking into it and not getting a definitive answer. The issue here is that taking a site offline has surely been widely understood as the ultimate robots.txt `Disallow` instruction to search engines. IMO we should respect that.