4 ms·
>collating and creating these scrapes has absorbed an enormous amount of my time & energy due to the need to solve CAPTCHAs,... Have you considered automating
by ryanlol 11y ago
>collating and creating these scrapes has absorbed an enormous amount of my time & energy due to the need to solve CAPTCHAs,...
Have you considered automating this?
- smeyer 11y agoThe whole point of CAPTCHAs is to be difficult to automate. Or are you suggesting automating farming out the CAPTCHA solutions to cheap workers?
- jMyles 11y agoI assumed it was a joke. But maybe not?
- MichaelGG 11y agoThere are plenty of services that do exactly that. They're pretty cheap.
- ryanlol 11y agoThere's a plenty of service providers that sell APIs to captcha solving services at reasonable prices.
- amenghra 11y agoOr if you don't want to spend money, you can always re-host things on your own site. Let your visitors do the work for you.
- davidgerard 11y agoThe main problem is that most CAPTCHAs are terrible, and do a better job of keeping humans out than robots.
- timboslice 11y agoYes. Quick list of providers I've worked with, in no particular order: http://www.imagetyperz.com/ http://www.imagetyperz.com/ http://expertdecoders.com/ http://expertdecoders.com/ http://www.deathbycaptcha.com/user/login http://www.deathbycaptcha.com/user/login https://de-captcher.com/ https://de-captcher.com/ http://bypasscaptcha.com/ http://bypasscaptcha.com/
- gwern 11y agoI did, but the problem is that I never expected to be scraping for so long and it was always easier to just solve by hand than do a complete rewrite and allow for using CAPTCHA libraries. If I had known I would be scraping for ~3 years, I would have done many things differently: http://www.gwern.net/Black-market%20archives#how-to-crawl-markets http://www.gwern.net/Black-market%20archives#how-to-crawl-ma...