I have thought about using subreddit images as an image classifier for ML training. (Like using r/food images to create an ML model that identifies food). This

I have thought about using subreddit images as an image classifier for ML training. (Like using r/food images to create an ML model that identifies food). This looks single threaded and probably wont scale well if you're trying to use multiple machines to grab a year's worth of images.