3 ms·
The Archive doesn't delete anything; depending on the current robots.txt, they may not show pages from past crawls. Update the robots.txt and you should be goo
by pronoiac 11y ago
The Archive doesn't delete anything; depending on the current robots.txt, they may not show pages from past crawls.
Update the robots.txt and you should be good to go.