3 ms·

What's to pirate? Anyone can crawl reddit now, right?

• K0balt 3y ago
  Nope, not in bulk. They have antiscraper limits in their api. But we could web scrape it with an AI agent looking for quality training data… It would be a TOS violation, so technically piracy I think still.
  • kjkjadksj 3y ago
    People probably just do it the old fashioned way with a botnet doing scraping under the rate limit.
    • K0balt 3y ago
      Show HN: I built a botnet to scrape Reddit and why I used OrbitDB and rust