8 ms·
I've found myself resisting posting comments on Reddit recently - things like answers to simple questions people have about SQLite - partly because I don't want
by simonw 3y ago
I've found myself resisting posting comments on Reddit recently - things like answers to simple questions people have about SQLite - partly because I don't want to cross the picket line but also because I realize that I was relying on a very light social contract that was in place there: I would share my knowledge for free, in exchange for which I knew that I was contributing to a larger dataset that myself and others could get back out again.
If Reddit are cutting off free API access, that social contract no longer holds. Why should I work to benefit their service if they're hoarding the resulting data and not making it available to me or people like me in the future?
I thought I was vanishingly rare in caring about this kind of thing, but given the mass Reddit blackout over the changes to the API apparently I'm not!
- xeromal 3y agoI blocked reddit in my hosts file and have found my news through other means. Here and fark.com lol
- ProllyInfamous 3y agoSame on my local PiHole =D It's worked the couple times I instinctively sought reddit advice.
- stevenhubertron 3y agoSame for me on NextDNS
- dvt 3y ago> I was relying on a very light social contract that was in place there This was never a social contract so I actually wonder how you or the original blog poster ever got to that idea. In fact, it's explicitly not the social contract if you ever read the Terms of Service of sites like Twitter and/or Reddit.
- derefr 3y agoYou're thinking of a legal contract. A social contract is what two sides do in practice in order to not piss the other off.
- dvt 3y agoI know exactly what a social contract is, and it's always superseded by a legal contract (which the ToS sort-of is, though it would have to go through the courts if challenged). Given that the ToS explicitly says that Reddit et al. can do whatever they want with your data, the idea that there's a social contract there is wishful thinking.
- digitalsushi 3y agoI get what simonw is saying though. Reddit: We could sell API access to your answers, per our TOS reddit poster: k Reddit: We're gonna sell API access to your answers, per our TOS reddit poster: then nevermind Both have a superseding TOS but the social contract is still appreciable
- lcnPylGDnU4H9OF 3y ago> wishful thinking It remains to be seen who is thinking wishfully. If Reddit dies because their users all go away, there really may have been a social contract which Reddit breached. Reddit has a ToS which may attempt to supersede such a social contract but it doesn't necessarily.
- derefr 3y agoUhh... I really don't think you do know what a social contract is. A social contract is a temporary state of affairs, where both sides are benefitting from being able to implicitly hold the other side to it; where either side can freely breach it, but where this dissolves the social contract that held until that moment; and where dissolving the social contract will (obviously) cause the other side to rescind all benefits they were granting the other, and instead revert to whatever it perceives as the game-theoretic global optimum — usually involving local indefinite defection, to "make an example of" the party that violated the social contract. A ceasefire during a battle is an example of a social contract. Neither side shoots until the other does. Once someone shoots, the other side responds with everything they have, to make an example of the side that shot first. Not eating your coworkers' food in the office fridge is another example of a social contract. Once someone violates it, people either stop putting food in the fridge, or start petty games of bringing random leftovers dosed with ex-lax to work and leaving them in the fridge. A social contract isn't "superseded by a legal contract"; a social contract is relied upon in preference to a legal contract. The legal system only applies when a given social contract is broken and dissolved by one party breaching it, thus leaving no recourse other than the underlying legal reality. The social contract for Reddit, that did exist until it was breached, was "Reddit lets people consume its data for free; and in exchange, users act to curate and maintain and grow the data, rather than actively polluting/destroying/lessening the data." Now that that social contract is dissolved, users are doing everything they can to make Reddit a shithole.
- constantly 3y agoNot to worry, you can still search google/etc., which scrapes Reddit, or Reddit itself through its native search. No need to use an API explicitly to access content like that.
- jlick 3y agoIn my googling this week by far the vast majority of promising reddit links for my searches have resulted in the "r/[subreddit] will go dark..." message instead of the discussion. Usually only the first reddit result has the "Cached" link available. I suppose there's probably a way to force Google to use the cache for other links but knowing that there's a cached link available is already something few regular users are aware of.
- Springtime 3y agoReddit not long ago announced a plan to delete all comments from a submission whenever an OP deleted their submission (ordinarily only the OP's post would be deleted). There was quite a lot of pushback since the consensus was many comments aren't just for the benefit of the OP but everyone (in fact sometimes the OP doesn't even appreciate the comments they receive but are nevertheless useful to others). So Reddit walked it back but it does show many of the site's users are conscious of the broader utility of comments outside of just the smaller contextual interactions.
- david422 3y ago> things like answers to simple questions people have about SQLite What about just to answer the guy who had the question?
- mkoubaa 3y agoA little inconvenient but you could Ask/answer it on stack overflow and then link it in the reddit reply?
- miah_ 3y agoStack Overflow is under a moderator strike at the moment too! The company has disabled the data dumps of the content after a recent layoff. https://meta.stackexchange.com/questions/390106/moderation-strike-update-data-dumps-choosing-representatives-gpt-data-and-wh https://meta.stackexchange.com/questions/390106/moderation-s...
- clmckinley 3y agoI predict that all sites like this which thrive on community generated content will be getting rid of apis and bulk exports. This is because ai companies have used those tools to build their systems on data that prevents the need to the source website. This is an existential threat to sites like StackOverflow and a huge, missed opportunity for reddit.
- drchaos 3y agoAI companies can just scrape the content, and since the sites don't have an exclusive license to it (it's user-generated, after all) there is little they can do against that. Actually, I'm not even sure the AI companies don't do this already. If I'd start such a company, I'd invest in a generic crawler once, instead of building countless integrations for all the different, proprietary APIs or dump formats.
- ZoomerCretin 3y agoCan someone explain to me why Reddit can't have different price tiers for their API service? Why can't they charge people who want to scrape en masse (LLM trainers) 10-100x more than mobile app API users?
- thewataccount 3y agoAbsolutely nothing. I don't understand why they don't just support OAuth and then the api usage would be by user, not by the app itself. Otherwise apps like apollo technically would be some of the biggest "users" of the api. What's wild to me isn't just the amount, it's the lack of time. In theory APollo might have enough users will to pay enough for them to profit (albiet with a fraction of the users). But because there's no time, and because people bought year long subscriptions, he's stuck with his subscribers paying less then their operating cost.
- The_Blade 3y ago> I don't understand why they don't just support OAuth OAuth breaks peoples brains and I can only imagine the tech / political debt reddit has
- ribosometronome 3y agoIsn't this why people are upset? It's pretty transparently them giving the axe to third party apps when they explicitly said that wasn't what they were going to be doing. People don't like being lied to or treated like they're too stupid to know what you're actually doing.
- roskelld 3y agoI figured because they don't want 3rd party apps because they don't run ads for Reddit. Reddit wants users within their (soon to be) walled garden getting fed all of the monetization pressure systems. My take when Reddit said that Apollo cost them $20M a year, they weren't talking running costs but revenue potential because Apollo doesn't feed ads to its users.
- 3y ago
- PaulHoule 3y agoReally? The average discussion on Reddit/StackOverflow/etc is full of wrong answers and it is hit or miss if the "accepted" answer is correct, never mind any of the other ones. These sites are a great model for convincing bullshit but if you wanted something worth training an A.I. you'd need to filter out 90% of the content.
- clnq 3y agoSadly very true. Most threads are very comparable to ChatGPT 3.5. I think one could recreate Reddit mostly with a LLM.
- vinnymac 3y agoYea, the future of public discussions online is interesting to consider. LLM bots are already a thing, comments posted here could be from a bot. We don't have a way to really confirm it, and I am not sure it actually matters (yet).
- HPsquared 3y agoReddit probably was a pretty big part of LLM training data. It has a vast trove of conversation on niche topics, and pairings of "what is said in response to input X". Probably the monetisation of the API is an attempt to capitalize on those users.
- jamietanna 3y agoFortunately /r/SubredditSimulator has been a thing for a while https://www.engadget.com/2019-06-05-subreddit-simulator-gpt-2-bots.html https://www.engadget.com/2019-06-05-subreddit-simulator-gpt-...
- renewiltord 3y agoMy experience is that it is a good source for leads on things to do but not for convincing facts. And an LLM is good for that too. I still end up needing both. An example of something is someone posting that their AKG headphones will only charge on the USB-C plug if the other end is USB-A. I couldn't get mine to charge, and that was the answer. That answer existed only on Reddit, until recently when someone had that same problem on another forum.
- NelsonMinar 3y agoThanks for articulating what I meant by the social contract, Simon. I feel the same way, which is why I wrote the post. General reply to other comments: y'all are right, the post is short and doesn't flesh out all the arguments necessary. But I think I captured the spirit of something about how we, the creators on the Internet, feel about the bargain we strike when we invest in sites like Reddit or Twitter or indeed, Hacker News here.
- dylan604 3y agoThe funny thing to me is this sort of expectation that a site/app that accepts user contributed content must provide access to it other than the site/app it was submitted.
- jangxx 3y agoSo are you saying that because I submitted a lot of reddit comments through Apollo I should also be able to access them through Apollo? Because that's a statement I would agree with but I'm not sure it's what you meant.
- simonw 3y agoI assume that most sites won't do that - so I don't invest much of my time and effort in most sites. Reddit had 17 years of track record of providing access, which had eventually bought my trust. They're setting that trust on fire right now.
- dylan604 3y agoI stipulate that a 30 day notice for a major change from something that has been available for 17 years is pretty egregious. However, I'm still of the mind that when you build a company/product that 100% depends on a 3rd party existing or allowing one to play in their playground, these are the exact situations that can arise. You have to know that at some point, if the dependency is no longer available, neither is your product regardless of the reason for the lack of availability. That's just how it goes. Yes, it sucks to have the product of your blood, sweat, tears get invalidated, but that is where you chose to put that effort while knowing the caveats
- simonw 3y agoSure, and that's why I haven't built a commercial product on top of Reddit. (I actually did run a startup on top of Twitter's API between 2010-2013 - I'm VERY glad not to have to worry about that any more!) I'm not talking about this in terms of being an app developer: I'm talking about it in terms of being a regular user posting content on the site. If you rug-pull my expectations on access to that data in the future, don't be surprised if I find somewhere else to spend my time.
- stevenhubertron 3y agoSame. I usually spend a few hours a week helping people with 3d printer issues and since all this has blown up I have just ignored it all. Not worth putting that knowledge into Reddit and toying with deleting that which I have contributed already.
- grawlinson 3y agoIt would be much better if this knowledge was available elsewhere for other souls to peruse. Say, maybe, a blog?
- stevenhubertron 3y agoI do have it cross-posted to my blog actually, and have my downloadable profiles there.
- Pet_Ant 3y ago> Why should I work to benefit their service if they're hoarding the resulting data and not making it available to me or people like me in the future? This I believe is generally called "digital sharecropping" https://www.roughtype.com/?p=634 https://www.roughtype.com/?p=634 > What’s being concentrated, in other words, is not content but the economic value of content. MySpace, Facebook, and many other businesses have realized that they can give away the tools of production but maintain ownership over the resulting products. One of the fundamental economic characteristics of Web 2.0 is the distribution of production into the hands of the many and the concentration of the economic rewards into the hands of the few. It’s a sharecropping system, but the sharecroppers are generally happy because their interest lies in self-expression or socializing, not in making money, and, besides, the economic value of each of their individual contributions is trivial. It’s only by aggregating those contributions on a massive scale – on a web scale – that the business becomes lucrative.
- brookst 3y agoAggregation theory: https://stratechery.com/aggregation-theory/ https://stratechery.com/aggregation-theory/
- throwaway49274 3y agoPlease explain to me where Reddit is no longer free for Joe Consumer? It's the subreddit mods who are making the data inaccessible to you, NOT Reddit.
- sn0wf1re 3y agoIt will no longer be free to browse how you like. You will be forced to use Reddit's Apps, Reddit's website, etc. Along with the tracking and restrictions that they impose (Future removal of NSFW is an example of a restriction).
- LeeroyWasHere 3y agoThe people working for free are the villains, not the multibillion dollar corporation. Got it, thanks.
- clmckinley 3y agoAre they a multibillion dollar corporation though? I know they have had crazy valuation's, but we are moving past a time of value based on eyeballs and to a time of value based on monetization. Where does the monetary value of reddit really lie? It seems like most of their creative monetization strategies like gold, donations and custom avatars have failed. This leaves the more mundane avenues of advertising to users, and selling the content that users creates. Both of those are severely handicapped by a free/low cost api. If they cannot monetize a user or their data then that user is bad for their bottom line. reddit is doing this because their investors want them to be a multi-billion dollar company, not because they already are.
- arrosenberg 3y ago"It's the striking coal miners who are making heat inaccessible to you, NOT the mine owner"
- mardifoufs 3y agoImagine comparing coal miners to the equivalent of internet janitors who volunteer to work for free as long as they get their share of petty power. Tons of them are basically just protesting since they won't be able to exert said petty power as efficiently as they used to. I can't imagine getting to a point where I'd defend Reddit powermods, even over spez himself. But even in your very shaky analogy, the mods are at worse the petty bourgeois, not some sort of proletariat of Reddit wtf.
- dietr1ch 3y agoSame, I wish we could contribute content (posts, comments, votes, etc) in a redistributable way. I'd like to a P2P-backed service to exist, where people can own all the data. I guess that abuse would be a challenge, but there's probably enough good ideas around bittorrent and cryptocurrency to make sharing and trust/voting possible. My dream is that people could have a ~raspberry at home helping host the internet in a sparse way. Would it be more inefficient than a centralized service? sure, but decentralization is inherently more expensive, yet better thanks to true shared ownership.
- zrm 3y agoInefficiency was always a red herring. $ curl https://www.reddit.com https://www.reddit.com > /dev/null % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 970k 0 970k 0 0 840k 0 --:--:-- 0:00:01 --:--:-- 840k That's just the index, not images or anything pulled in by scripts. That page takes longer to download on a gigabit internet connection than the <5kB page it ought to be could be uploaded from some asymmetric 10Mbps up cable connection. The biggest problem is actually funding. The centralized site puts ads on it or tells VCs they could, and then has money to pay for developers or other things that increase the user base. It's the same reason Linux is used by programmers and not graphic designers. If there is anything deficient about it in the programmer's workflow they fix it for everybody. If there is anything deficient about it in the graphic designer's workflow, they don't know how to fix it so they get a Mac and run Adobe. Social media sites work more like the latter than the former until someone finds a way around that.
- dietr1ch 3y agoI'm not too concerned about efficiency either. Growing with slow and spotty rural internet taught me the hard way that data locality is key. Also, with enough data, having to get only what you care about is probably faster.
- dvno42 3y agoI feel very similarly. I have mixed feelings on my actions but I just finished running shreddit on all of my comments and deleting my accounts. I wrote content with the (possibly misguided) notion that what I contributed would continue to be openly accessible/searchable. I didn't want what I wrote to end up in a locked up walled garden like Meta's products. Imho Reddit will continue to put walls up around user contributed data. I decided to delete everything while I still could.
- princevegeta89 3y agoThis makes the idea that sites like Reddit only live and thrive because of user generated content and they're nothing without it, reverberate all across the room. Looking at what Reddit has done, it makes things obvious to me that the APIs that are free to use are only a gimmick and companies can pull the plug on you as a consumer at any moment. I mean, I can easily imagine that Reddit originally published its API to look "cool" but look at what money has done today. Why could you not make an offer to buy out Apollo or other 3rd party clients before you closed out your API Reddit? Fuck your leadership and the so called idiots on your management team that pulled ideas straight from a dumpyard.
- slily 3y agoOn one hand I understand not wanting to contribute to a commercial content aggregator that you feel doesn't return enough value to its users, but it sounds like you still use it, i.e. the more restrictive API pricing does not discount its value enough for you to discontinue your use of the site. As far as refusing to contribute, I don't see the practical difference between that and refusing to help someone in trouble out in the street. You get even less for your trouble in the latter case, but I'm sure you wouldn't demand some value back for answering a question in real life even to a stranger you'll never meet again. Sure, a middleman is profiting off of your answer here, but getting hung up on the share of value is how so much of the web shifted from free collaborative passion projects to for-profit Patreon paywalls and the like.
- AndrewDavis 3y agoI'm making a concerted effort not to open reddit, and as a result am spending more time doing side project things. One such project has been modding an old video game console. On multiple occasions when running into issues, search results are pointing me to reddit posts which I've tried to avoid in favour of alternative results but I find myself still needing more information only to discover the links are to blacked out subreddits - it has been brutal!
- porl 3y agoI'm in a similar boat. Thankfully you can often use an internet cache to view the contents (this doesn't help Reddit out, which would defeat the purpose of the protest). I've done this for a few coding things that I needed an answer fast. It does show how much will be lost if things don't improve, but like you I didn't want to fuel Reddit in any way (assuming the sub is even open anyway).