2 ms·
> Whenever I deal with a scraping process that decides it wants my entire business, and it wants all of it RIGHT NOW, or in 5 minutes, I want to find the person
by dale_glass 2y ago
> Whenever I deal with a scraping process that decides it wants my entire business, and it wants all of it RIGHT NOW, or in 5 minutes, I want to find the person and sit them down in a room and tell them "hey, develop your own ideas and business. Ok? Thanks"
That's a lot of righteous anger for somebody building a business on top of other people's data.
"Broadcastify is the worlds largest source of public safety, aircraft, rail, and marine radio live audio streams."
I have no sympathy whatsoever. You're just complaining about the very thing you're doing. If it's fair for you to do that, it's fair for others to do it to you.
- blantonl 2y agoThey volunteer to provide the data to us. Every single last one of them. Nowhere in our business model did we make the conscious decision to say "hey, look at that business, they have something, and I'm going to take it."
- bsuvc 2y agoReading public website data is not "taking it". It is still there. Observing publicly available information is not theft, nor is it illegal. Of course copyright rules apply, but that is for if you reproduce something.
- blantonl 2y agoreproduce something No one is developing a 5 server cluster with 200+ 4g modems to observe publicly available information. They are using said cluster to deliberately work around blocks, rate limits, and restrictions on scrapers who are scraping content solely to reproduce the data and use it for commercial purposes (make money)
- schlipity 2y agoAren't you also volunteering your data? Don't browsers just talk to your webserver and say "Hey, what do you have?" and your site responds in kind.