2 ms·
Do you have any examples where URLs that were only discovered via toolbar reporting (from one or any number of visitors) appear in Google's search results, even
by gojomo 17y ago
Do you have any examples where URLs that were only discovered via toolbar reporting (from one or any number of visitors) appear in Google's search results, even though never linked from any other page?
Some sites use unique per-user access URLs as their only access-control; I would have expected more tales of woe if such URLs regularly received Googlebot visits or appeared in search results.
- jacquesm 17y agoI've personally had the googlebot visit an under-construction site that happened to have a few juicy keywords on it. This led to a lot of trouble... Since then no more google toolbar for me. Google denied involvement, we later figured that it might have been an adsense or analytics tag as well, but there are supposedly no flows of data between those projects. The damage was done, the page should have been password protected, we learned our lesson and moved on without spending a whole lot of time on finding out if there may have been another cause, we couldn't see another one that was likely. There are plenty of other cases like this on the web, Google has always denied any kind of flow from the toolbar or adsense/analytics to their search crawler. One thing I do know: if you are building a website and you have adsense tags on the page you can not password protect it and expect to receive relevant ads because the adsense crawler can not reach your content. AFAIK the best workaround for this problem is detecting the bot and presenting a different page (or at least one without a log in). The google toolbar license ( http://tools.google.com/tools/firefox/toolbar/FT3/intl/en/install.html http://tools.google.com/tools/firefox/toolbar/FT3/intl/en/in... ) contains this little tidbit: "Google's Search Service Google Toolbar is designed to be used in conjunction with Google's search services. Accordingly, your use of Google Toolbar is also defined by Google's Terms of Service and Privacy Policy. " And nowhere does it explicitly state that the toolbar data is not used to enhance the search engine results, personally if they had no other use for it as a discovery tool then I would wonder why it was made in the first place. If google does not use the toolbar data in any way then it would be a small matter for them to say so loud and clear in the toolbar license or their privacy policy.
- gojomo 17y agoAnother possibility: if the page had outlinks, the URL could appear in public referrer logs elsewhere. (Pages like intranet login-only wikis often reveal their internal URL structure to outside sites that way.)
- jacquesm 17y agoThat's a good one! Thank you, I had not thought of that possibility. Then if that other site logs its statistics publically that would do it.