JackInFact

3 ms·

1. 1.▲
   by JackInFact 16y ago

   I considered that. It seems like the only solution (to me). When the <meta> tag for a canonical tag is available it seems pretty easy to solve that way. I'm really curious how Google (and other search engines) solve this problem. Do
2. 2.▲
   Writing a Generalized Web Crawler to map all the URLs on web sites?

   2 points by JackInFact 16y ago|3 comments