4 ms·
How did you get the URLs given the reddit history search limit? Was it from the big-query dataset?
by Chris2048 8y ago
How did you get the URLs given the reddit history search limit? Was it from the big-query dataset?
- stared 8y agoTo be honest, I have no idea. See https://github.com/EBazarov/nsfw_data_source_urls/ https://github.com/EBazarov/nsfw_data_source_urls/ for the data source I used. There is a Reddit bulk downloader capable of downloading ~1000 images from a subreddot: https://github.com/aliparlakci/bulk-downloader-for-reddit https://github.com/aliparlakci/bulk-downloader-for-reddit (or just image links, if needed); I tested it and it works well. Though, I have no idea if it was used for the project.