4 ms·
Is their robots.txt valid? https://duckduckgo.com/robots.txt https://duckduckgo.com/robots.txt # No search result pages Disallow: /*?
by InsomniacL 7y ago
Is their robots.txt valid?
https://duckduckgo.com/robots.txt https://duckduckgo.com/robots.txt
# No search result pages
Disallow: /*?
- rbinv 7y agoIt is valid, and so are Google's results as the URLs don't contain a question mark.
- deleted 7y ago[deleted]