3 ms·
Printing each story exactly once is tough. The RSS feed serial number thing never worked. Sites with multiple RSS servers and a load balancer would return a dif
by Animats 6y ago
Printing each story exactly once is tough. The RSS feed serial number thing never worked. Sites with multiple RSS servers and a load balancer would return a different serial number. I ended up taking the MD5 of the title and description fields, with HTML markup deleted, and discarding new feed items with a duplicated MD5.
- bscphil 6y agoThat would be a start, but unfortunately Reuters frequently changes their article titles too.