3 ms·
And the bumph at the top - crawlers run by Yahoo! and Google - lol
by Neil44 4y ago
And the bumph at the top - crawlers run by Yahoo! and Google - lol
- judge2020 4y agoIt’s the default drupal robots.txt it seems. https://api.drupal.org/api/drupal/robots.txt/5.x https://api.drupal.org/api/drupal/robots.txt/5.x