3 ms·
I maintain two web sites that date back to 2003. They are still very active (thousands to tens of thousands of uniques per day), but I and my users have notice
by reaperducer 8y ago
I maintain two web sites that date back to 2003. They are still very active (thousands to tens of thousands of uniques per day), but I and my users have noticed that only the more recent content (2012+) shows up in Google.
In a way I’m had to hear that Google is delisting the older content because I thought I was doing something wrong.
But it’s still frustrating for my visitors because every few months I get a message about how they can’t believe all the information there is on the site that they’ve searched for for years but never found through search engines but it’s all right there on this one site. (It’s something of a regional history site.)
I guess those sites have involuntarily become part of the “dark web.”
- specialist 8y agoIs it possible to check your access logs, see if google how much google, others are spidering? I know very little about google's SOP, but had the impression they periodically rescan stuff.
- reaperducer 8y agoI've built new sitemaps, submitted them to Webmaster Tools (or whatever they're calling it this week), requested a re-spider, everything. Duck Duck Go finds it and shows it. According to the logs, Google spiders it, but chooses not to show it.
- dcbadacd 8y agoGoogle's spider is weird anyways. I have a site that has sitemaps submitted like three months ago and it still hasn't taken a look at them.