4 ms·
Sigh. Duplicates on the front page of HN, that is the first time I've seen that. The URLs are different but they point to the same page. Perhaps a quick MD5 has
by ChuckMcM 10y ago
Sigh. Duplicates on the front page of HN, that is the first time I've seen that. The URLs are different but they point to the same page. Perhaps a quick MD5 hash of the page would be a good way to check for duplicate pages.
- jsnell 10y agoOr just special-casing the #. trash from Medium. For popular articles you can see half a dozen duplicate submissions that differ just by the tracking IDs. (But maybe that'd be too invasive now that Medium posts are served from so many domains).