4 ms·
No. For each item on HN I pull the referenced page, parse the HTML and extract the text between "<title>" and "</title>". I compare those, as well as comparin
by DupDetector 16y ago
No. For each item on HN I pull the referenced page, parse the HTML and extract the text between "<title>" and "</title>". I compare those, as well as comparing the domain names. I don't parse the title from the HN submission, but from the page that has been referenced from the submission.
Is that clearer?