johnmu

5 ms·

1.
by johnmu 12y ago
And one more thing ... you have some paths that are generating more URLs on their own without showing different content, for example: http://www.languagespy.com/politics/uk/trends/70th/70th-anni... http
2.
by johnmu 12y ago
FWIW I think the main problem is that you're essentially creating an "infinite space," meaning there's an extremely high number of URLs that are findable through crawling your pages, and the more pages we crawl, the more
3.
by johnmu 12y ago
Having a page that goes nofollow/noindex and back is fine, when we recrawl it, we'll take the new state into account.
4.
by johnmu 12y ago
Hi, I work with the Google crawling & indexing teams. Let me check with them to see what their recommendation would be. At first glance (based on the pages cached), it seems like we're just following the links within your site, lik
5.
by johnmu 12y ago
Unblocking via robots.txt is fine and won't cause problems.
6.
by johnmu 12y ago
It's important for us (I work at Google on web-search) to be transparent about these reports, and we use them to remove / block content that is malicious too (just like other sites can use the Safe-Browsing API to get information
7.
by johnmu 12y ago
Handling URLs with multiple slashes in them is tricky, lots of websites silently fold them into one and return the same content, so this seems like something we should handle in the same way in search.
8.
by johnmu 12y ago
If you want to send me specific queries (the more general, the better) and what went wrong in the search results for them, I'm more than happy to forward them to the team that works on that. I'm [this-user-name] AT google.com
9.
by johnmu 12y ago
(I work with the search team at Google) This was a bug on our side, and should be resolved now.
10.
by johnmu 12y ago
This is just a bug, sorry.
11.
by johnmu 13y ago
(I work at Google on webmaster issues) Your site has a manual spam action probably based on something a previous owner had on it ( https://web.archive.org/web/20110202220759/http://smitecamp.... shows sc