10 ms·
The slow evaporation of the free/open source surplus
- api 2y ago> OSS burnout. Very few FOSS projects are lucky enough to have grown a sustainable and supportive community. Most of the time, it seems to be a never-ending parade of angry demands with very little reward. When the software labour market was growing steadily, burned out maintainers often got replaced by fresh-eyed graduates or coders who relied on the project at work. This is big not just because of angry demanding "gimme free stuff slave!" users but burn-out due to the realization that open source in 2024 is often just free labor for SaaS companies. Open source should not be considered "free." It should be a kind of gift culture where one is expected to give something back. Showing up with angry demands for something someone made for free makes you a parasite and an asshole.
- Multicomp 2y agoYeah you used to be able to get nerd street cred as an OSS maintainer, and the cost was your time and willingness to work on A) the code and B) whatever contribution processes you/others came up with. The downsides were known. Now, you have this yawning chasm opening of large companies taking your work and selling it back to you, or LLMs remixing your work and diffusing it out, both demotivating factors that combined with the economic insecurity and COVID lockdowns forcing people to re-evaluate their hobby priorities, I'm not surprised there's less maintainers.
- bjornsing 2y agoUnpopular take here on HN, but I’m not sure that this is a bad thing.
- xedrac 2y agoHow so? Are you saying open source itself is not a good thing, and if everything was proprietary, things would be better?
- andrewmcwatters 2y agoI use uncountable amounts of open source components that should cost me a minimum of something. If anything, at least enough to fund a project’s VPS hosting or annual domain costs.
- zzzeek 2y agohave you looked into funding platforms for those projects? most projects on github have a "sponsors" tab that links to a variety of platforms most prominently github sponsors itself, but also tidelift, etc
- bjornsing 2y agoNo I think open source has its place, especially for foundational stuff like compilers and OS kernels. I’m less sure about the marginal benefit of more open source in the future. IMHO it tends to create an expectation that all interesting and challenging work should be uncompensated, and the role of most software engineers should be to just cobble together open source components to make some clueless SaaS founder rich. Not saying I know what the solution is though.
- ang_cire 2y agoWell, we could add commercial use prohibition into our OSS licenses.
- criddell 2y agoYou can add whatever you want in your license and none of it matters unless you are prepared to go to court. Even then, you might have a hard time getting the company to respond if they aren’t based in the same country as you. For example, Onyx is a Chinese company that makes a line of e-ink tablets (Boox) that are based on open source software. AFAIK, they have refused to honor the terms of the GPL and release their modifications.
- 2y ago
- zzzeek 2y agolots of bullets in this blogpost but here are some gems > OSS burnout. Very few FOSS projects are lucky enough to have grown a sustainable and supportive community. Most of the time, it seems to be a never-ending parade of angry demands with very little reward. > People who are unemployed or jaded by the software industry have fewer side projects, because – let’s be honest – there are healthier hobbies available. > There’s less funding for non-AI software startups, who are usually very heavy OSS users. > Declining surplus and burnout leads to maintainers increasingly stepping back from their projects.
- jw_cook 2y agoFor what it's worth: Thank you for your work on SQLAlchemy and Alembic! On large projects like those, what ratio of community interactions would you say are angry/demanding vs supportive/helpful? And any advice for dealing with the negative ones? For me, probably less than 5% of interactions on PRs/issues/discussions are negative, but even that small amout sure does have a way of draining one's enthusiasm and motivation!
- zzzeek 2y agoif you put angry/demanding vs supportive/helpful on a 0-10 scale, things hover in the 6-7 range typically. i think computer programming for whatever reason correlates a lot with a certain kind of impatience that we all have. I have gobs of it. We're all fighting it each day to not piss each other off because when youre in "flow" we all know how it is when whatever OSS project suddenly surprises you. truth be told I spend my OSS maintenance day being more and more pissed off all day really and a lot of it comes from the desire to recognize when people are either subtly or not-so-subtly asking of you to make sacrifices for them. The person who didn't read the docs, the person who didn't read your "new issue" template asking them to please open a discussion since they likely didn't find a bug, to write clear self-contained demonstration code and to not assume your well defined and documented behavior is a "bug, let me know when this is fixed", the programmers who are asking you to upend your whole project for what they in a very dunning-kruger sense think is a good idea, these are all things that someone can respond to in a patient and friendly manner. Heck anyone that works in the service industry has to have an iron-clad patient and friendly manner with all forms of idiots and jerks, including when it's me. But for me personally, doing the open source thing, and also quite obviously for a lot of other folks doing it, man it's hard to keep the fireballs in check while at the same time giving each of these users a clue that there's something they could be doing to make life easier for the maintainers of the project that they are using for free. rant over I guess!
- layer8 2y ago> Short version: my mental model of FOSS is that it’s a function of industry and labour surplus I believe that originally it was more a function of college students spending their free time on it. Of course, this results in addressing fewer enterprise-level use cases.
- entropicdrifter 2y agoCollege students, hobbyists, enthusiast outsiders with no formal education. It's originally the product of amateurs, in the original sense of the word: people doing something for the love of it.
- sulandor 2y agoyou mean like curl, samba or sqlite?
- layer8 2y agoI mean like Linux, and Unix tools like vi. “College students” is maybe too limiting, but a large number of early open-source projects came out of university environments.
- sulandor 2y agoyes, linux also is a good example of a student project that addressed a lot of enterprise-level use cases
- Eridrus 2y agoEven if you look at industry contributions, this is not actually why code is open sourced. The individual incentive is to open source code to show the rest of the industry what you have been able to build, with personal returns to you if it actually gets meaningful adoption. And companies are willing to go along with this because infrastructure projects are not actually a source of competitive advantage and they would rather co-operate on keeping input costs low, and also not get stranded on a tech island with totally custom tooling for everything. You also derive some marginal benefit if the OSS code actually gets used by others since you still control the project direction. And then separately you have OSS first companies that are hoping that being OSS lets them gain a marketing/sales advantage with developers who care about that. These incentives remain the same even if there is no meaningful surplus.
- jeffbee 2y agoThe counterpoint would seem to be that OSS now more plentiful than ever and accelerating.
- sulandor 2y ago> more plentiful than ever and accelerating. sounds like a good thing at first
- matrix87 2y agoIf corporation x uses my thing to cut labor costs and doesn't pay me anything while actual employees get to sit around and make six figures adding fields to jsons, that's a shitty arrangement for me If corporation x didn't exist, I probably wouldn't worry about it. But the second money becomes involved it changes the calculus And I do think some projects like ad blockers are worth it because corporations don't benefit much from them, but regular people do
- matrix_overload 2y agoThey are not paid 6 figures to add fields to JSONs. They are paid 6 figures to brainrot into obsolescence instead of going out there and creating a competing product. The last part is working very well. Most of the innovation these days is coming from China.
- ykonstant 2y agoCan you be explicit about the last part?
- hyeonwho4 2y agoI would guess they are referring to the idea that large established companies (usually monopolies) have little motivation to compete of features/technology, especially when that would cannibalize their main offering. Generally, an engineer working on something at Microsoft or Apple is going to be much less motivated to create new tech than one at a (Chinese) small business. But it gets worse than this: they sometimes hire engineers just to keep them from the competition. That said, China has its own unique category of underutilized staff: those who are hired to work for state-owned enterprises.
- matrix87 2y agoHaving a bunch of teams adding fields to JSONs doesn't exclude the end result of a competing product. You need bricks to build pyramids The point I was making was 6 figures for that vs nothing for maintaining some dependency they use is very one-sided
- ab5tract 2y agoNon-zero interest rates do not equal “high” interest rates.
- lanstin 2y agoFrom one of the articles the article refers to: "[According to Harvard something] value of OSS to the economy is 4.15 Billion USD." That seems ludicrously low - Linux itself, if you value it at $1 per install is considerably more that 4 billion USD. The various open source web projects powering all the large sites are more than billions. Banks may not pay for SSL but they receive economic value. Etc. etc. And it's not a labor surplus except for those poor souls that are trying to make their fortune with an OSS "side project." It is a method of doing things where results are shared and improved upon, fundamentally the scientific way brought into applications. Unlike physical devices, it's essentially free to share software. Just don't put access controls on the git repos. There is a tendency to overly productize things, but that's not the heart of open source; the heart is just to share results, perhaps in a hope that ones labor can contribute to the progress of humanity. I don't need to promise to fix issues ever for my source code to potentially have value to someone solving a similar problem. Now, it's harder to achieve this way of working in corporations, and things have to split into "open source with some modular hooks for private things that aren't open source" (even just in-house logging or metrics systems), but it's not impossible, and does have the same advantage science has - it grows exponentially and eventually will figure out how to do anything that is doable.
- bee_rider 2y agoI do agree that the open source ecosystem seems worth more than that. But $1 per Linux install seems like a kind of arbitrary pick that might not meet our intuition, if you want to hit 4B installs. Like, there are only ~8B people, and most of them don’t use Linux on the desktop, so we must be including other uses of Linux. Routers, IOT. I’m pretty sure my lightbulbs run Linux. Is Linux supplying $1 of value per lightbulb? I’m not sure, I suspect smart bulb manufacturers could have gone with some proprietary stack if Linux didn’t exist, and it might cost less than $1 per lightbulb… actually, I have no idea, but I don’t think $1 is an obvious lower bound.
- stonemetal12 2y agoOkay so lets say $10 for every Android cellphone that puts you at 30 billion. Not sure how you want to estimate server installs but a quick google puts forth 96% of web servers run Linux.
- Arcuru 2y agoI think that if you use OSS projects as much as the typical HN user, you should be giving money to at least some of them. If your OSS contribution budget is $0, you're part of the problem. The same of course applies to companies but 1000x more.
- Mc91 2y agoI make good salary right now, someone sending me $20 or $100 doesn't really mean anything. I used to make money off someone else's open source project. I offered him a couple hundred dollars and he said he didn't need it. For the OSS projects I work on someone coming in and fixing bugs and whatnot would be more helpful. Of course, it depends on the project, some of them do need money.
- jauntywundrkind 2y agoLove Baldur's writings in general. Smart & insightful, great topics. I do feel like the mental model here - industry & labor - defines away a lot of the currents that arose open source. These factors are the industrial/capitalist view of open source! Perhaps I was just young and naive, but man, it was such a an exciting time to be alive, and it was so clear to young me that computers already could do anything you asked them to do, and that they were getting soaringly better all the time, and that we were building new world spanning interactive mediums and revamping how society communicated with itself. It was a grand project, and the term I heard recently & love vocational awe barely contains the magnitude of interests & awe I had & still have. And it was such an open accessible time. Reading ajaxian.com was a constant torrent of regular folk inventing futures. We were harkening always towards new better protocols and libraries. It felt so much more than industrial. And the scale of activity was on such a more personal, small innovator level. There weren't huge teams maintaining React or Nextjs. There were a couple folks creating Comet, or BEEP, and sharing not just the output but more engaged in an arena of ideas, discussing on blogs and comments the tradeoffs & nitty gritty. Lately, tech hasn't been accessible, and it hasn't been cool. Open source used to be the connection for cool and accessible, used to be endless blogrolls that would suck folks in and let them see & become part of that project of building the new world. Open source has, as it's gotten more economically important and larger scale, become just a taken for granted tool, not something that was going to alloy & enhance our lives or expand our thinking. The motivations matter, the image matters, the cause matters, the drive matters. We can look at industry and labor from a rationalist economic view, to assess open source, but the philosophy and motivations to me are more interesting, define the energies or lack that create the awe & passion that drive this amazing open source world, that impel people in.
- xipho 2y agoWhat about Blender? Is it not a canonical success story? I feel that science, art, and tools that provide personal agency are all compelling landscapes for open-source fruition.
- fsloth 2y agoOne of the reasons Blender is so amazing is that it's an outlier. It's also not in the class "generating billions of dollars of value" unlike some basic components like, say, Linux kernel or SSH to name a few (in an ocean of extremely valuable software components).
- xipho 2y ago> It's also not in the class "generating billions of dollars of value" Clearly not as much as Linux, but almost certainly it's already been a part of asset creation or use within film and video games that topped billions of dollars. The movie RRR alone is 160m+ worldwide (See in part https://www.blender.org/get-involved/user-stories/ https://www.blender.org/get-involved/user-stories/).
- robinsonb5 2y ago> We don’t yet know which parts of the FOSS system is sustainable, Probably the parts that have been around for decades. As someone who's created open source software in the past, I'm put off mostly the explosion in software complexity over the last two decades, the constant churn in libraries and tooling which places an unreasonable maintenance burden on a spare-time hobbyist, and the bad taste left in the mouth by Microsoft using copilot to license-launder the github corpus. I still produce open source software and gateware on a recreational basis, but in quiet little backwaters of the noosphere which aren't going to change the world (or be tainted by AI) any time soon!
- apantel 2y ago> Microsoft using copilot to license-launder the github corpus Isn’t the game with licenses that you must specify what can and cannot be done with the code? It’s a big issue that no one prior to now had the foresight to forbid ML training on code without attribution. If the licenses going back 30 years had that stipulation then it would be easy to take down Copilot and ChatGPT. But the licenses simply don’t cover the use case of training a neural net, so it’s probably going to slip through the cracks just like SaaS slipped through the cracks of the GPL by not distributing code, hence the need for AGPL. So I’m sure we’ll see these kinds of clauses added to licenses going forward, but they can’t be applied retroactively. The irony in all this is that from the start, open source licensing has been a game of wits where software creators try to cleverly use copyright as a lever of control. Well, they weren’t clever enough. They missed ML training and didn’t forbid it. As a result they’ve basically lost the whole game.
- NoraCodes 2y ago> Isn’t the game with licenses that you must specify what can and cannot be done with the code? No, not at all. Microsoft's argument is that training an LLM on code is fair use, and thus doesn't trigger copyright-based licensing at all. That's why they include unlicensed code in Copilot, which under a training-triggers-copyright theory they have no right to at all.
- 2y ago
- abetusk 2y agoI generally try to stay away from responding to these posts but it's starting to feel like it's an astroturf concern trolling strategy. I'm not sure I've properly digested the article but, just from a cursory look, it doesn't even mention the exponentially decreasing costs of compute. I'm not sure my model is correct by I suspect the main driving factor of why FOSS exists and is successful is that the tax imposed by current copyright/IP laws is too usury and FOSS provides a mechanism to circumvent it and provide/capture the value from the dropping costs of compute. Is the FOSS surplus evaporating? Maybe, but my default position is no. I'd be willing to change that position if some evidence were provided. The article provides none. Articles like "Is the Open Source Bubble about to Burst?" are click-baity titles that seem on the razors edge of bad faith. The author of that article claims to be a FOSS advocate so I don't know. Maybe I'm reading too much into things and this is really fallout from some EU politics I'm not fully looped into.
- phkahler 2y agoI think the factors listed in the article will result in less commercial OSS contributions. Also as investment dries up, software folks will have more free time to do hobby development. Reduced commercial interest may also allow new GPL projects (a.k.a Free Software) rather than the recent trend toward "commercializable" open source.
- 0xbadcafebee 2y agoFOSS is an activity taken up by people who want a particular solution to a problem. When the tech and IT industry were vastly smaller than it is today, there was actually a larger number of high-quality FOSS projects. Today there are more FOSS projects than ever by number, but a good chunk are what I would call "throwaway" projects. Another large amount are projects that just exist to fill gaps in new ecosystems (a new language/framework/platform/etc appears, and now they need a lot of projects to provide libraries to fill needs). And there's lots of immature engineers who are growing up in a culture without documentation, and too quick to reference snippets than learn a tool completely. Tech itself is changing, and that will (and does) affect open source. But the existence of open source is self-perpetuating at this point. There isn't really a bubble to burst. FOSS will continue to be here as long as the computer allows anyone to create and share a work for free that can be reused and there is a need for. It is not sustainable, because it does not need sustaining. Anybody with an internet connection can decide for themselves to create open source. As long as we provide an unimpeded means to share their work (newsgroups, mailing lists, FTP, mirrors, etc), there will be open source. And as long as somebody has leisure time, and there are nerds to be interested in programming during their leisure time, some will spend it on open source. It's like "sports": people will still play sports regardless of a business motive. I think people are shocked by the whole "business source" license thing, but I'm not. Open Source was never a business model, no matter how much some of its proponents wanted it to be. It's taken a while for people to learn that lesson, but it's starting to sink in. The fact that fewer startups will be open source now isn't going to change the open source community at all. The community will be here regardless of what any business (or individual government) wants. As far as "our reliance on open source", that's just a happy accident. It's free of charge and free of use, so business uses it. If for some reason it stopped being free of charge or free of use, then business would just pay for proprietary software like it used to. I don't see this happening anytime soon, though, unless somebody passes a law banning Copyleft.
- cxr 2y agoA test to try out whenever these blog posts show up describing the burnout that is purportedly endemic to "open source": If you ignore GitHub, how many of the problems described go away (and of the ones that remain, how potent are they)? The problems are not intrinsic to "open source". Conflating GitHub culture with open source is like conflating being on Twitter with using the Internet.
- jw_cook 2y agoCould you elaborate a bit? Do you think said "GitHub culture" is just because it's the largest platform, or more intrinsic qualities of the platform? Anecdotally I see many of the same problems elsewhere (GitLab, and even independent/self-hosted), but some things I can think of that might be more unique to GitHub are: * The larger presence of commercial OSS projects setting a tone of "projects here are products to be marketed" * Social media-like features encouraging popularity contests, curating a personal brand, etc. * Both of the above leading to more users acting like you owe them something ("you're competing for my attention, right?") I'm not 100% convinced that those or other GitHub-specific factors are primary causes of maintainer burnout, but I think it's certainly possible.
- cxr 2y ago> Do you think said "GitHub culture" is just because it's the largest platform, or more intrinsic qualities of the platform? Neither. Everyone and everything develops a culture and/or a set of norms. This is the one that emerged on GitHub. Looking for the reason inside the machine is misguided. It's the people. > Anecdotally I see many of the same problems elsewhere (GitLab, and even independent/self-hosted) Putting your repo and bugtracker somewhere that isn't github.com isn't sufficient to neutralize the GitHub culture. (Do people from country/culture X stop being affected by it when they go off and spend the summer in country Y?) For many or maybe even most people doing open source on GitHub today, they're not even going to know which direction to drive towards in order to achieve the norms of pre-GitHub culture because they never experienced it.
- squarefoot 2y agoThe article seems to deal only with FOSS coming straight from the enterprise world, also as a byproduct of professional developers' free time. This is sometimes the case, but it also misses completely what FOSS is for non professional developers: their best possible resume; and that is not going away anytime soon.
- deleted 2y ago[deleted]
- jmull 2y agoIs there anything here that isn’t purely speculative? What are the signs that OSS is actually in decline? BTW, I’m not sure there’s anything wrong if OSS is in decline. Overwhelmingly, people do it not to get paid or help industry but because they love building things and solving problems. If people are generally finding better ways to do that, then good for them. Or if people have less time for OSS due to general economic circumstances, then that is a sad thing, but that’s not specific to OSS, so it’s a bit weird to frame it that way. That is, if people have fewer opportunities to find personal satisfaction in their lives, that’s bad across the board, not just for OSS.
- gen220 2y agoI think the extent to which one could say open source software is in decline is driven by the fact that FOSS was recently considered by many big VC firms to be an “investable category” and now that view is less popular. True FOSS has always been uninvestable, healthy, and small. But we’ve had a lot of “eventually fake” (non-MIT/GPL) FOSS in the last decade. Elasticsearch, mongodb, cockroach, and so on. True FOSS (maintainers not beholden to rent-seeking investors), as always, trudges along. Because it’s growth is not correlated to market returns.
- rwmj 2y agoThe whole article is evidence-free nonsense. Free software has been around for at least 50 years, and will still be around as long as programmers want to scratch an itch or just enjoy (as you put it well) finding personal satisfaction from it.
- __MatrixMan__ 2y agoI think the article gets this upside down. When 100 companies have an identical problem, and it's not a problem that's in the domain of what they're competing over, then it's a tremendous waste of labor for them to come up with 100 separate solutions. It's just cheaper for them to allow enough wiggle room that the problem gets solved in the open so they can all get on to focusing on whatever it is that makes them different from their competitors.
- whb101 2y agoWrote about this a few years ago. > In giving companies a free pass to enter the “open source community,” however, certain hackers said “take what you want and give what you want” to a bunch of organizations built around maximizing the ratio of the former to the latter. Like the author says, investment by these entities can balloon the (F)OSS ecosystem, but when they contract (as is inevitable in a boom-and-bust economy), the nonrenewable resources that actually write the stuff (humans) will burn out. https://boilingdown.ghost.io/cooperation/ https://boilingdown.ghost.io/cooperation/
- Almondsetat 2y agoOpen source people don't know how to market themselves, and those who do are accused of exploiting FOSS for - GASP! - personal gains. If every owner of every semi-important open source project set up a business license with support they would not only make money, but they could also leave their current job that holds back their development time and make an even better piece of software. But no, most open source will always be considered as gratis and side-project worthy because the authors themselves treat it as such
- bawolff 2y agoI'm pretty unconvinced. I think the author thinks the primary motivation for open source is companies making a donation out of the goodness of their heart. While that does happen, i dont think that is the main cause. Most companies participate in open source for their own selfish reasons. Sometimes that is to attract talent, sometimes it is to attract people to their propreitary platform, sometimes it is to commodify the parts they dont want to compete on, sometimes its something else. The companies do get benefits here. They are probably going to continue so long as the benefit > costs. As for non corporate open source. It may not be a healthy hobby, but i dont see anything changing here. If people have been doing it as a hobby for the last 20 years, why would they stop now?
- mid-kid 2y agoThis, I don't think open source can be properly characterised through the lens of capitalism. There will always be students, academics, and people who don't work in software at all, willing to try their hand at developing something for their own use, which may or may not get traction in the grander scheme. It doesn't have to be an "unhealthy" hobby if you pace yourself and draw lines around what you're willing to do or not.
- bawolff 2y agoI also think there will always be people who really like software development but aren't able to fit into the corporate world. The article mentions rich devs with too much time on their hand, but i've also seen some open source devs who are actually quite poor and underemployed, that simply, for whatever reason seem incapable of thriving in traditional corporate software jobs.
- lliamander 2y agoThat's the thing, while there is value in investing in open source (for corporations and individuals) that value is often speculative and hard to quantify. When times are tough, people tend to focus on short-term, concrete benefits.
- franciscop 2y agoI've been doing and following OSS for over a decade now and this is the first time I feel like a piece on OSS excludes me. I started in the maker communities in Europe, and most OSS creators I know of are small hobbyists all over the place, not particularly "California rich devs with spare time". In fact I believe that demographic might be (relatively!) under-represented, they have startups to work on after all!
- hintymad 2y agoThere's also uneven concentration of the open-source effort. In the past 15 years, companies, or at least the companies I worked for, loved open sourcing their systems for better reputation, for larger community support, and for not getting left behind by competing solutions. I sense that the tide has changed. Now we have a lot more mature solutions than a few years ago. Few companies are growing so fast on a new domain that calls for brand new systems, either. So, the cost of open-sourcing a system may outweigh the benefits. Nowadays, it is more often than not that a system startup open-sources their systems to gain user traction, and soon makes their systems only source-available. And rightly so. They have a business to run anyway, and they certain don't have any obligation to open source their bread and butter. There is another factor: the fun is always in new challenges, yet a lot of software development has more chores than challenges. I remember many years ago a pretty popular blog explained why Linux did not have a nice UI compared to Windows or MacOS. The main reason, the author argued, was that tweaking UI was not necessarily fun, and we achieved great UI from thousands and thousands of incremental improvements, more often than not painstakingly. An engineer who worked on open source in her spare time most likely did not have incentives to make such improvements. I mean, what's the fun in that? In contrast, people work for free to create amazing libraries in the field of deep learning. I'd venture to guess that's because there's tons of fun in working the "sexy" part of the engineering: deep understanding of optimizations and healthy dose of mathematics, chances to apply or even invent all kinds of engineering tricks, very cool results, potentially huge impact, cheering from a large community, and etc. Such projects are deep, are personal, and are super fun to work on. On the other hand, I'm not sure how many new fun projects (at least in the area of distributed systems) are out there that have outsized impact to the community, compared to 10 years ago.
- hcfman 2y agoOpen source is great! I use it all the time. However, what I did not expect is how hard it is to get new open source to be used by people. You can have wonderful features but without a really large amount of marketing effort the pickup can be really slow. Unless you have help from the right influencers. And without traction it will either die or go in another direction, possibly close source/commercial. What's also sad is the legal system can change, making the cost to entry for commercial use of software for small players much higher or risky. Some people will have worked for years on open source, possibly thinking it can be something they can do commercially after they retire for example, then governments bring out a law with a 15 million euro penalty if you are not compliant (Cyber Resilience Act). I guess this is a big kudos to those whose persistence have made it succeed for them!
- herdonbesecker 2y ago[dead]