3 ms·
Just support Google's AJAX crawling standards and disallow the escaped_fragment requests from crawlers that are not on your whitelist.
by evgen 16y ago
Just support Google's AJAX crawling standards and disallow the escaped_fragment requests from crawlers that are not on your whitelist.