3 ms·
Author here. Yes, "serve" is the correct interpretation. It is not clear how Google gets ahold of offending URLs within blacklisted domains (like the article sa
by gomox 6y ago
Author here. Yes, "serve" is the correct interpretation. It is not clear how Google gets ahold of offending URLs within blacklisted domains (like the article says, there were no offending URLs provided to us).
Theories:
* Obtained from users of Google Chrome that load specific URLs in their browsers
* Obtained from scanning GMail emails that contain links to URLs
* Obtained from third parties that report these URLs
- londons_explore 6y agoThe main way is via the Googlebot crawler. They also use user reports from Chrome, and links in "mark phishing" emails from Gmail. Those latter two cases the URL is considered private data, so won't be reported in webmaster tools.
- dharmab 6y agoWe’ve seen internal firewalled URLs in the webmaster tools, so I’m not sure the private data works as intended.
- londons_explore 6y agoMaybe there is some kind of "if multiple users see the same URL, it isn't private" logic going on.
- aasasd 6y agoI've seen some bot of Google's in the server logs on my in-construction not-publicly-available page, a minute after I opened the page in Chrome. That was about five of six years ago, shortly before I stopped using Chrome.