3 ms·
> one of the things I did for my project was to scan headlines Can I ask where you scrape them from? (Google News?) Is it possible to scrape past headlines fro
by throwaway613834 9y ago
> one of the things I did for my project was to scan headlines
Can I ask where you scrape them from? (Google News?) Is it possible to scrape past headlines from somewhere too, or do you just have to keep up with it every day?
- cknight 9y agoRSS feeds of various news websites give me a daily shortlist which I manually approve to prevent false positives and duplicate stories. Since that manual part essentially means I am using it as a feed reader, I assume that's not breaking any terms of service from those providers. For past news the only one I have been able to use is The Guardian's API, which is free for non-profits such as my Suitocracy project. It's... not great, but it's something. A start.
- throwaway613834 9y agoAh I see, okay thank you!