3 ms·
Just for fun, here is the robots.txt from that site: # Default robots file version:2 User-agent: \* Disallow: /calendar/action\* Disallow: /ev
by ape4 5y ago
Just for fun, here is the robots.txt from that site:
# Default robots file version:2
User-agent: \*
Disallow: /calendar/action\*
Disallow: /events/action\*
Allow: /*.css
Allow: /*.js
Disallow: /\*?
Crawl-delay: 3
Sitemap: https://mccarthygarberlaw.com/sitemap_index.xml