4 ms·

Wow, didn’t see that coming…. (lol) Hopefully, the dataset will be pirated and released into the de-facto public domain, since it was always considered by the

by K0balt 3y ago

Wow, didn’t see that coming…. (lol) Hopefully, the dataset will be pirated and released into the de-facto public domain, since it was always considered by the users to be a commons, not an intellectual slave farm.

pavel_lishin 3y ago
What's to pirate? Anyone can crawl reddit now, right?
- K0balt 3y ago
  Nope, not in bulk. They have antiscraper limits in their api. But we could web scrape it with an AI agent looking for quality training data… It would be a TOS violation, so technically piracy I think still.
  - kjkjadksj 3y ago
    People probably just do it the old fashioned way with a botnet doing scraping under the rate limit.
    - K0balt 3y ago
      Show HN: I built a botnet to scrape Reddit and why I used OrbitDB and rust