3 ms·
I read the core of 3taps' counterclaim — pages 25-30 — and I recommend it. It's a good read. Specifics of 3taps' scraping aside, I'm starting to see that this
by graue 14y ago
I read the core of 3taps' counterclaim — pages 25-30 — and I recommend it. It's a good read.
Specifics of 3taps' scraping aside, I'm starting to see that this is a particular case of a general problem that also applies to Twitter, with its recent API changes. They and Craigslist each control access to an extremely large and growing volume of user-generated content that people post there with the intention of making public. Users post that content to Craigslist/Twitter primarily because each is the largest website of its type. And both sites are, increasingly, trying to preserve their control by restricting third-party access to the UGC inside them, at the cost of reduced innovation.
It's worth dwelling on the fact that large, powerful corporations can be built off the backs of user-generated content in this way. What do you do when a service like this adds a term in their TOU that you don't like? When their web UI is lacking basic functionality? Runs really slow? Doesn't work in your favorite browser? In any of these cases, you hit a big roadblock, because you don't really have a choice. The content is on Craigslist/Twitter — even though these companies did not create it.
This problem seems to be one that will recur over and over on the internet. I can see three main avenues to fight it:
1. Technological — Create decentralized services that are competitive with, and somehow eventually overtake, the centralized ones. This is what StatusNet, Tent.io and several other efforts are trying to do in the social networking space. But this is hard. Decentralization makes it much more complicated to even build a working service at all, let alone one with a consistent, smooth and intuitive user experience. And success would result in less profit, compared to solving the much easier problem of building a successful centralized service. So developers who could pull this off are strongly incentivized not to.
2. Organizational — Start nonprofit organizations that are committed to interoperability and innovation in their bylaws, and have them run centralized services. This has been done successfully at least once: Wikipedia, operated by the Wikimedia Foundation. Their nonprofit status doesn't mean everyone is happy with their management, or that Wikipedia is perfect. But they provide full data dumps, and the content is under a free license, and their Statement of Purpose (https://wikimediafoundation.org/wiki/Wikimedia_Foundation_bylaws#ARTICLE_II_-_STATEMENT_OF_PURPOSE https://wikimediafoundation.org/wiki/Wikimedia_Foundation_by...) would make it hard to justify changing that. So, no matter what, you can always innovate with content on Wikipedia.
Wikipedia was the first site of its kind, so it got big the same way major commercial sites did — by having the right idea and execution at the right time. It would be hard to replicate that success in 2012 by creating a nonprofit-owned Twitter clone. But now that Wikipedia is established, it seems to work.
3. Legal — Just as there are privacy protections in the law (moreso in the EU than the US), so could there be regulatory requirements for web services over a certain size to allow some degree of interoperability.
If we don't find some kind of solution, I imagine that in 5 or 10 years, large incumbent internet sites like Twitter, Craigslist and heck, let's throw Facebook in there as well, could be the new RIAA and MPAA, using the aggregate value of their content to bludgeon competitors into submission and restrict innovation, to the detriment of the public, except that in this case, it's that very public that created the content enabling these companies to bully others in the first place. Craigslist v. 3Taps is not the end of this.