3 ms·
I would set NOFOLLOW but not bother with NOINDEX, assuming those crawlers handle the same meta tags google does. That way news.yc pages people link to from oth
by brlewis 19y ago
I would set NOFOLLOW but not bother with NOINDEX, assuming those crawlers handle the same meta tags google does. That way news.yc pages people link to from other sites would be indexed, but x urls would be left alone.
I do not currently use Yahoo or MSN search, but would rather not have the option of using them cut off.