3 ms·
Very cool. I noticed that it's mangling some of my URLs, though. `/!0ead1aEq` is getting turned into `/%210ead1aEq` (the exclamation point is getting percent-
by queezey 9y ago
Very cool.
I noticed that it's mangling some of my URLs, though.
`/!0ead1aEq` is getting turned into `/%210ead1aEq` (the exclamation point is getting percent-encoded), which leads to a bunch of spurious 404 errors.
https://tools.ietf.org/html/rfc3986#section-3.3 https://tools.ietf.org/html/rfc3986#section-3.3
- seanwilson 9y agoAh, thanks a good bug report! I'll get this fixed.
- seanwilson 9y agoHmm, so when crawling, URLs are normalised and the URL library I'm using is normalising the "!" to "%21". Could you send me a working URL to test on? My email is sw@seanw.org if you want to use that.