2 ms·
One idea I had was to turn http://www.arthunted.com http://www.arthunted.com into a service. So you can specify parameters and sites to crawl and gather data, o
by chrischen 12y ago
One idea I had was to turn http://www.arthunted.com http://www.arthunted.com into a service. So you can specify parameters and sites to crawl and gather data, on demand. $5 a day times xxxx users.
- boomzilla 12y agoscrapinghub seems to be the top dog in this space. You might want to check it out. What's your background? Are you looking for business idea that can be built upon your existing site, or are you looking for something completely new?
- chrischen 12y agoIt doesn't have to be a business idea! Just an interesting idea that would otherwise require a lot of compute or storage, or something else provided by AWS.
- sinsanati456 12y agochrischen. I am also facing similar situation. So, which out of all the suggestions did you found the most interesting one ? And what have you actually planned doing with it ?