4 ms·
Google ignores robots.txt if the number of inbound links is > N? Also - any speculation as to how so many sites were lining to peoples login pages?
by cleverjake 14y ago
Google ignores robots.txt if the number of inbound links is > N?
Also - any speculation as to how so many sites were lining to peoples login pages?