3 ms·

my problem with almost every program is a lack of deduplication. really only techmeme and google news deduplicate stories well. i want ten places covering one

by basch 10y ago

my problem with almost every program is a lack of deduplication. really only techmeme and google news deduplicate stories well. i want ten places covering one story to show up only once, with ten links to the variants.

messutied 10y ago
I'm definitively putting more effort in this, thanks
- basch 10y ago
  if the reddit link is bloomberg and the slashdot link is business insider, they should still show up as one story, with links to both discussions.
  - messutied 10y ago
    Exactly my thoughts!, Im just a little concerned on how to accurately determine when two different links are the same story, it would be very bad to join different stories into one by mistake
    - basch 10y ago
      can you parse techmeme or google news or someone that already does it?