4 ms·
Ask HN: How does GoogleBot treat url encoding?
Suppose I have the following situation:
I used to have all my url's nicely url-encoded on my website in <a> tags.
Then someone made a mistake causing half of the url to be encoded and half of the url NOT to be encoded.
For normal webbrowsers, no problem, but what about GoogleBot?
Will GoogleBot understand that this is a single resource or will I end up with duplicate content & get punished by Google in the search rankings.
- mike-cardwell 16y agoI would be hugely surprised if Google was stupid enough to identify them as different urls.
- c1sc0 16y agoI figured as much but wanted to ask anyway. btw. I looked at some old logs and GoogleBot indeed does 'the right thing': no funny characters in there.