6 ms·
Encoding your email address to hexadecimal may prevent some less sophisticated crawlers from capturing your email address. mailto: -> mailto: abc@gmail.com ->
by bitmedley 7y ago
Encoding your email address to hexadecimal may prevent some less sophisticated crawlers from capturing your email address.
mailto: -> mailto:
abc@gmail.com -> abc@gmail.com
Then instead of:
<a href="mailto:abc@gmail.com">abc@gmail.com</a>
Use this:
<a href="mailto:abc@gmail.com">
abc@gmail.com</a>
Or this ("mailto:" also encoded):
<a href="mailto:abc@gmail.com">
abc@gmail.com</a>
source: http://www.wbwip.com/wbw/emailencoder.html http://www.wbwip.com/wbw/emailencoder.html
- sebazzz 7y agoWouldn't any decent HTML library, probably already used by the crawler, convert that back to plain text?
- onion2k 7y agoIf you're crawling the web looking for email addresses you're probably not bothering to parse the HTML. You don't need to: you can just grab the email from the raw response from the web server, along with any new links to follow.