3 ms·
If your potential customers are willing to pay to scrape data, why aren't they will to pay for the data from the source directly? Is it not available or is it c
by wombatpm 5y ago
If your potential customers are willing to pay to scrape data, why aren't they will to pay for the data from the source directly? Is it not available or is it considered exclusive or proprietary. I'm thinking about the lawsuits around deep linking and TicketMaster. Web scraping at scale is a never ending arms race because designs evolve or the host is actively trying to thwart you.
- fforflo 5y agoI like these two questions! They can crystallise things. Wasn't aware of the Ticketmaster v. Tickets.com case. Will have to print it along the SCOTUS LinkedIn v. hiQ ruling.
- max002 5y agoSo for new companies the data (that a lot of time IS publicly available) cost a lot of money, i.e. Api access or charing per requests. A lot of time companies start with scraping and then once they have more customers (and data access price can be shared amongst them) they switch to paying for it.