3 ms·
1) Because they block it in the robots.txt file : https://web.archive.org/robots.txt https://web.archive.org/robots.txt 2) They are creating a search engine fo
by deadalus 11y ago
1) Because they block it in the robots.txt file : https://web.archive.org/robots.txt https://web.archive.org/robots.txt
2) They are creating a search engine for this very purpose.