7 ms·

Has anyone ever thought about using all of reddits porn subs for machine learning? There must be 10s (or even 100s) of thousand of images (kind of) neatly organ

Has anyone ever thought about using all of reddits porn subs for machine learning? There must be 10s (or even 100s) of thousand of images (kind of) neatly organized by gender, boob size, ass size, skin color, age, ...

komali2 10y ago
Or any porn website.
- yoodenvranx 10y ago
  The advantage of reddit is that you can also get tons of cats, dogs, cars, landscapes, food, ... all from the same place with the same scraper.
  - aab0 10y ago
    If you want fine-grained tagging/categorization, you would be even better off with the -boorus.
flashman 10y ago
Quick plug for my map of NSFW Reddit: http://electronsoup.net/nsfw_subreddits/ http://electronsoup.net/nsfw_subreddits/
- throwanem 10y ago
  Unusable on mobile. In portrait, the sidebar covers everything; in landscape, it still covers half the viewport, and touch panning works but resets the position of the graph to what I assume is center or origin on every drag. Hate to seem harsh, but I felt it worth mentioning, since it's why I'm unable to give any more substantive feedback on the project.
  - flashman 10y ago
    Not at all designed to be compatible with mobile.
- Tobu 10y ago
  Cool visualisation, but it doesn't have links to the subreddits?
edude03 10y ago
I thought of doing this but my bottleneck is scraping the images since I don't have terrabtytes of bandwidth and imgur would likely rate limit me. But given the data set my plan is/was to extract tags by mapping images to the sub Reddit they're posted in then categorize based on that
- i336_ 10y ago
  Contabo are 100Mbit but unmetered, ridiculously cheap. Reddit's main issue is that you can only do one call (via OAuth) per second. I recommend using the new(ish) "thing" call where you can get up to 100 things at once, or alternatively rockets.cc, which occasionally falls apart but is pretty good
  - minimaxir 10y ago
    There's no reason to scrape Reddit for the image URLs when you can download all NSFW image links on Reddit via BigQuery.
    - s_kilk 10y ago
      Beware, many subs mark links as NSFW to indicate spoilers, rather than pornographic content.
      - minimaxir 10y ago
        Obviously you can filter on specific subreddits. :P
deleted 10y ago
[deleted]

komali2 10y ago

Or any porn website.

yoodenvranx 10y ago
The advantage of reddit is that you can also get tons of cats, dogs, cars, landscapes, food, ... all from the same place with the same scraper.
- aab0 10y ago
  If you want fine-grained tagging/categorization, you would be even better off with the -boorus.

flashman 10y ago

Quick plug for my map of NSFW Reddit: http://electronsoup.net/nsfw_subreddits/ http://electronsoup.net/nsfw_subreddits/

throwanem 10y ago
Unusable on mobile. In portrait, the sidebar covers everything; in landscape, it still covers half the viewport, and touch panning works but resets the position of the graph to what I assume is center or origin on every drag. Hate to seem harsh, but I felt it worth mentioning, since it's why I'm unable to give any more substantive feedback on the project.
- flashman 10y ago
  Not at all designed to be compatible with mobile.
Tobu 10y ago
Cool visualisation, but it doesn't have links to the subreddits?

edude03 10y ago

I thought of doing this but my bottleneck is scraping the images since I don't have terrabtytes of bandwidth and imgur would likely rate limit me. But given the data set my plan is/was to extract tags by mapping images to the sub Reddit they're posted in then categorize based on that

i336_ 10y ago
Contabo are 100Mbit but unmetered, ridiculously cheap. Reddit's main issue is that you can only do one call (via OAuth) per second. I recommend using the new(ish) "thing" call where you can get up to 100 things at once, or alternatively rockets.cc, which occasionally falls apart but is pretty good
- minimaxir 10y ago
  There's no reason to scrape Reddit for the image URLs when you can download all NSFW image links on Reddit via BigQuery.
  - s_kilk 10y ago
    Beware, many subs mark links as NSFW to indicate spoilers, rather than pornographic content.
    - minimaxir 10y ago
      Obviously you can filter on specific subreddits. :P

deleted 10y ago

[deleted]