Internally, represent the articles as IDs. This will eliminate duplicate posts, though not necessarily duplicate articles linked in posts. You can periodically

Internally, represent the articles as IDs. This will eliminate duplicate posts, though not necessarily duplicate articles linked in posts. You can periodically fetch and cache the title pretty easily, since the ID is most of the (interesting characters in the) URL for the page.