3 ms·

Download this Dataset of 12,118 Yahoo Answers for $1

• johnm212 5y ago
  > we scraped it all (at least as many as we could find on their English site) 12,118 questions There's a lot more questions on Yahoo Answers. Their robots.txt file contains a sitemap: https://answers.yahoo.com/sitemaps/sitemap-us.xml https://answers.yahoo.com/sitemaps/sitemap-us.xml That sitemap contains links to 2,115 other sitemaps. Each of those sitemaps contains links to around 47k questions.
  • jeromechoo 5y ago
    Good find! Worth a follow up to get more!
• Huwyt_Nashi035 5y ago
  Use your tool to scrape FBI crime and victimisation statistics and you might reconsider the beneficiary of the proceeds.
  • quantstats 5y ago
    How strange, what do you mean by this comment? I just visited the website of the beneficiary of the proceeds and they have this to say about the death penalty[1], for example: “African Americans make up 42% of people on death row and 34% of those executed, but only 13% of the population is Black”. It sure sounds like racial bias to me! And I for one I’m glad the they chose this nonprofit organization which is doing excellent work. [1] https://eji.org/issues/death-penalty/ https://eji.org/issues/death-penalty/
    • Huwyt_Nashi035 5y ago
      Taking homicide as an example (a crime more likely than most to result in a trip to death row), the most recently available data (2019) [1] shows that 56% of perpetrators were black. That's quite a feat for 13% of the population! If anything, that only 42% of those on death row are black may be indicative of a racial bias in their favour. [1] https://ucr.fbi.gov/crime-in-the-u.s/2019/crime-in-the-u.s.-2019/tables/expanded-homicide-data-table-3.xls https://ucr.fbi.gov/crime-in-the-u.s/2019/crime-in-the-u.s.-...