4 ms·
They volunteer to provide the data to us. Every single last one of them. Nowhere in our business model did we make the conscious decision to say "hey, look at
by blantonl 2y ago
They volunteer to provide the data to us. Every single last one of them. Nowhere in our business model did we make the conscious decision to say "hey, look at that business, they have something, and I'm going to take it."
- bsuvc 2y agoReading public website data is not "taking it". It is still there. Observing publicly available information is not theft, nor is it illegal. Of course copyright rules apply, but that is for if you reproduce something.
- blantonl 2y agoreproduce something No one is developing a 5 server cluster with 200+ 4g modems to observe publicly available information. They are using said cluster to deliberately work around blocks, rate limits, and restrictions on scrapers who are scraping content solely to reproduce the data and use it for commercial purposes (make money)
- schlipity 2y agoAren't you also volunteering your data? Don't browsers just talk to your webserver and say "Hey, what do you have?" and your site responds in kind.