4 ms·

I've been working on a startup idea that involves a lot of scraping and I've thought about a general data market before but I came to the same conclusion that i

I've been working on a startup idea that involves a lot of scraping and I've thought about a general data market before but I came to the same conclusion that it is way too hard. I just use one of the many captcha solving services available and then build a convincing product around it that can be sold using "value based pricing". All big players in the "information" economy found other ways to make money then sell data directly, for example Google's attention market for online ads or payment for order flow in trading.

squatrito23 3y ago
The issue with general data markets is that they are too .. generic. They can't address the quality assurance problem, so as a buyer you'd end up doing you own due diligence for every merchant on the marketplace. As if you were to site-visit each Airbnb before you book a night there. A web-scraping dedicated marketplace might address this, surely not a generic one.