3 ms·
I disagree that it was grayed out to prevent scraping. I don't have a better suggestion, but professional intuition tells me the real reason was something reall
by Uehreka 12y ago
I disagree that it was grayed out to prevent scraping. I don't have a better suggestion, but professional intuition tells me the real reason was something really mundane and dumb that couldn't be figured out by someone unfamiliar with the codebase.
In the end though, I really liked that chart. How many weeks of articles did you scrape to get that data?
- minimaxir 12y agoIn that run, I scraped about 10k articles total, mostly from books and celebrities categories. (so 30% of them were listicles, believe it or not) I would have scraped more, except I got hit with Facebook's rate limit (600 requests / 600 seconds) even though I took explicit steps (1.1s delay between requests) to avoid said rate limit. Although in this case, more data might not improve the accuracy of the chart.