3 ms·

> All robots forbidden, except googlebot After which people keep claiming google search is better, not just given special treatment.