4 ms·
Disclaimer: I work for Red Hat but I'm here entirely with my own opinion My God, it's been a long time (if ever) since I've seen so much misinformation out th
by freedomben 6y ago
Disclaimer: I work for Red Hat but I'm here entirely with my own opinion
My God, it's been a long time (if ever) since I've seen so much misinformation out there. I mostly blame Red Hat for the very poor delivery, but tech people are not immune to the tendency for dramatizing, misrepresenting, and polarizing. Please stop spreading this. CentOS is NOT dead. CentOS is changing, but not all that much (yes, really).
I'll do my best to answer questions here, but I'm also going to rush a blog post to try and get it out ASAP that corrects a lot of this.
Edit: Here's the blog post. Excuse typos and other things, I rushed this ;-)
https://freedomben.medium.com/centos-is-not-dead-please-stop-saying-it-is-at-least-until-you-read-this-4b26b5c44877?sk=e500c2f16403d634ff8a4ea17d705252 https://freedomben.medium.com/centos-is-not-dead-please-stop...
- syshum 6y agoSorry but yes CentOS is dead CentOS, is COMMUNITY ENTERPRISE OPERATING SYSTEM The community is dead, the Enterprise part of the Operating system is dead Sure the CentOS name will be still around, but is clear that CentOS is now a Dev focused operating system not designed or targeted for Stable Enterprise operations with a community of Enterprise SysAdmins around it If you believe the changes are "not all the much" then you are clearly not in touch with the user base of CentOS, outside of Devs that is The changes are GREAT for devs, and Appliance Manufacturers. Maybe even for Cloud customers But for us Old School, OnPrem sysadmins running CentOS for Stability, and Long Term Support, CentOS is most certainly dead
- freedomben 6y ago> is clear that CentOS is now a Dev focused operating system not designed or targeted for Stable Enterprise operations with a community of Enterprise SysAdmins around it This is absolutely not true. Would you have described RHEL this way? If not, then you shouldn't describe CentOS this way either. CentOS took RHEL's place in the chain. Instead of Cent being downstream of RHEL, the two were swapped around. > If you believe the changes are "not all the much" then you are clearly not in touch with the user base of CentOS, outside of Devs that is Say what you will. I've been using Cent since 2012 and currently run numerous workloads in production on it. I've shipped SaaS products on top of it and have been responsible for widespread maintenance. I've been a package maintainer for numerous packages as well. > But for us Old School, OnPrem sysadmins running CentOS for Stability, and Long Term Support, CentOS is most certainly dead I know plenty of old school on prem sysadmins who run CentOS for stability and LTS (I'm one of them. I have 3 bare metal machines in prod at the moment running CentOS). I may go with Rocky for one of those machines (it's a router/load balancer), I haven't fully decided yet. That said I agree with you somewhat, that is the one area where this change could be somewhat negative. However, with CentOS being week and months behind RHEL right now, do you see that as a good thing? Do you like having an unpatched system for days or weeks at a time when an embargoed security fix hits RHEL and has to wait for CentOS to build and distribute? I don't. Security patches are top priority for me. Edit: Blog post mentioned is now live: https://freedomben.medium.com/centos-is-not-dead-please-stop-saying-it-is-at-least-until-you-read-this-4b26b5c44877?sk=e500c2f16403d634ff8a4ea17d705252 https://freedomben.medium.com/centos-is-not-dead-please-stop...
- chasil 6y agoEasy problem to solve. https://linux.oracle.com/switch/centos/ https://linux.oracle.com/switch/centos/ Similar to forcing Microsoft or Google to prompt the user for their desired browser or search provider, it would be interesting if rhel was forced to prompt for a repo provider. It would have been wiser to splash rhel support upgrades on CentOS gdm or cli cockpit than to threaten to kill a product. Really, what were you thinking? Nazgul indeed! Fork you! Old habits die hard.
- freedomben 6y agoHa! Red Hat is too evil so you move to Oracle :‑D > Really, what were you thinking? Nazgul indeed! Fork you! Glad we were able to have a productive conversation
- chasil 6y agoOracle offered freedom from the perspective of rhel, and I used it. I actually was granted IPO shares because of the things I wrote two decades ago. I think there was a fundamental misjudgment in what you have done. Oracle is more expensive on most tiers, but offers a $100 support level (forum-only, with updates) that undercuts all rhel agreements. Had you offered this support level, and advocated it (as I said) with gdm and CLI advertisements, you might have kept a great many in the fold. You did not do this, and now Oracle updated their repo conversion for CentOS 8. It is not too late. You should reconsider.
- syshum 6y ago>>However, with CentOS being week and months behind RHEL right now, do you see that as a good thing? Do you like having an unpatched system for days or weeks at a time when an embargoed security fix hits RHEL and has to wait for CentOS to build and distribute? I don't. Security patches are top priority for me. This is absolutely a False dilemma fallacy, there is absolutely nothing technically or legally prohibiting RedHat from releasing patches for both at the same time. Nothing. It is a sales/marketing or a internal process choice to do it that way. Changes to do this process, even moving CentOS to be ahead of RHEL is not the problem. The "rolling release" or non-release, or what every model they are calling it now with CentOS Stream is the problem. The fact that it will no longer be Binary Complete with RHEL is the problem, the fact that CentOS will be used as a "beta" (and spare me the marketing BS claiming it is not that) is the problem > Would you have described RHEL this way? RHEL is a targeted, Released Enterprise Operating system with a 10 year support cycle CentOS was a targeted, Released Enterprise Operating system with a 10 year support cycle CentOS Stream is not a targeted, released Enterprise operating system with 10 year support cycle. CentOS Stream is pseudo-rolling release with no point releases, used to build a targeted, released enterprise operating system.
- kd913 6y agoI don't work for Red Hat, but I saw a post that was saying that there is something in the works to fill the niche that CentOS offered. It just wasn't ready yet so the announcement hasn't been made yet. However, they needed to send a statement out regarding CentOS so companies were aware of what would be happening with CentOS 8 and perhaps avoid migration right now. For a community that depends on LTS, the sysadmins seem to make some rash decisions/drama. I think the logical decision here would surely be to wait and see what happens and make a decision in a year when support ending would actually become relevant.
- syshum 6y agoSome of this is timing. Many many many companies, right or wrong, wait until the very list minute to upgrade their legacy systems. Many of us are either still in the process or worse just finish our migration from CentOS 6 to CentOS 8, only to have the rug pulled out from under us. The sheer impact this move will have on many organizations is what is driving this emotional reaction If they would have honored the LifeCycle for CentOS 8, there would not have been the reaction you have seen 100% of the emotion / drama is coming from the choice RedHat has made to cut the supported life of CentOS 8 by 7 years. that is a DRASTIC action, and their belief that 12 months is "enough time" shows a clear ignorance of how the product is used in enterprise or they fully understand and are banking on the desperation of enterprise to sell RHEL licenses. either way it drastic choice by RedHat.
- freedomben 6y agoWell, we mostly agree! I agree with everything until: > their belief that 12 months is "enough time" shows a clear ignorance of how the product is used in enterprise or they fully understand and are banking on the desperation of enterprise to sell RHEL licenses. There's another explanation, and I think it makes a little more sense than yours which would require Red Hat, literally the company whose core job it is (which they are damn good at, enough so that you use it) to provide an enterprise distribution to some of the most conservative companies on the planet, to not understand how the product is used in enterprise. The suggestion that RH is "banking on the desperation of enterprise to sell RHEL licenses" at least makes sense given the facts, and that's kind of what I thought too when I first saw the news (the way they worded it sure made it seem like this was a money grab). It is possible however (and indeed this is my belief) that Red Hat doesn't consider Stream to be that big of a change, and they've given a full year to migrate. Indeed if you read my blog post[1] I don't think it's that big of a deal. I have zero inside info on this but I would bet highly that sales of RHEL were a factor in this decision for sure. I don't see how they couldn't be. But given how long Red Hat has been providing all their sources publicly (which they DON'T have to do) and acquiring and open sourcing companies, you don't give them even a tiny benefit of the doubt here that maybe their not just one-sided evil capitalists trying to squeeze nickels out of the CentOS community for short term gains? [1]: https://freedomben.medium.com/centos-is-not-dead-please-stop-saying-it-is-at-least-until-you-read-this-4b26b5c44877?sk=e500c2f16403d634ff8a4ea17d705252 https://freedomben.medium.com/centos-is-not-dead-please-stop...
- justahuman74 6y agoThe 'not all that much' is too much for most
- chasil 6y agoIf you have great ability to correct misinformation, then I would like you to bring back Red Hat 9 from 2003, fully updated with the latest RPMs. Red Hat demonstrated then exactly what it intended to do now.
- qz2 6y agoIt’s a bit arrogant telling everyone that they’re wrong when you’re changing the entire purpose of a product. It’s dead. It was accurately described already in the press release and that killed it. If there is backtracking it will make it more dead as it would break trust. It’s dead. You killed it some more here by shouting down the community. Edit: to clarify I have over 100 CentOS boxes which will not be running CentOS or RHEL next year.
- 8organicbits 6y ago> Edit: to clarify I have over 100 CentOS boxes which will not be running CentOS or RHEL next year. What distro(s) are you thinking of migrating towards?
- qz2 6y agoUbuntu LTS at the moment.
- RamRodification 6y agoWhy is that better than Debian in your opinion? We also run Ubuntu LTS but I need ammo.
- qz2 6y agoIt's not better. It's just less scary for the CxO class.
- joecot 6y agoSure. Since you say this is not a big deal and CentOS is not dead but is just changing, I really only have 2 questions: 1) What in your opinion were the main use cases for CentOS before this change announcement? 2) How do you think CentOS Stream is still viable for those use cases?
- freedomben 6y agoGreat questions, thank you. It may take me a bit to answer, but I will :-)
- freedomben 6y agoOk ready to answer. 1) I obviously can't speak for anyone but myself here, but in my use case, which I think is pretty common, is to use CentOS for production deployments of various web apps and services where a person prefers the rock solid stability of RHEL without incurring the cost, and does not need support to go along with it. 2) I explain this in depth in this blog post which is up now ( https://freedomben.medium.com/centos-is-not-dead-please-stop-saying-it-is-at-least-until-you-read-this-4b26b5c44877?sk=e500c2f16403d634ff8a4ea17d705252 https://freedomben.medium.com/centos-is-not-dead-please-stop... ), but the short version is that CentOS Stream is basically going where RHEL used to be. If RHEL was too bleeding edge for you, then CentOS Stream will be too, but otherwise it will be approximately the same as RHEL used to be. I consider RHEL and CentOS to be pretty equal, with CentOS lagging a bit behind. Now they will be pretty equal, with RHEL lagging a bit behind. Packages going to CentOS are packages that would have gone directly to RHEL previously.
- cesarb 6y ago> I consider RHEL and CentOS to be pretty equal, with CentOS lagging a bit behind. Now they will be pretty equal, with RHEL lagging a bit behind. Packages going to CentOS are packages that would have gone directly to RHEL previously. There will be another small difference: the number of updates. Just for fun, I started a centos:8 image in podman, installed the package which switches it to centos streams, and ran an update (which by the way partially failed with an error message, IIRC it tried to change /proc in a way podman doesn't like). Then I looked at the version of one of the updated packages before and after the update (IIRC it was bash), and looked at its changelog. There were several releases between these two versions, and I would expect each one of them to appear separately as an update within CentOS Stream. That is, packages that would have gone directly to RHEL previously will be going to CentOS, but not all packages going to CentOS will be going to RHEL; we will also be getting all the intermediate steps.
- quietbritishjim 6y agoI'm sure other commenters will put it much better than I could, but for those people that use CentOS for the purpose of a stable long term release, surely it is dead. The distribution now being called "CentOS" is almost at the opposite ends of the scale in terms of stability. The fact they've called this other thing the same name is purely marketing. If you destroy something then create something entirely different with the same name then the fact remains that you still destroyed the original thing. That's not dramatising or hyperbole.
- freedomben 6y ago> The distribution now being called "CentOS" is almost at the opposite ends of the scale in terms of stability. No, this is totally wrong (which is why I'm trying to correct it). CentOS will be where RHEL used to be. It is trading places with RHEL. It's not "the opposite end of the scale in terms of stability." CentOS will be roughly a single minor point release ahead of RHEL. Please read more about because that is super misleading and others are seeing things like this and propagating them: https://freedomben.medium.com/centos-is-not-dead-please-stop-saying-it-is-at-least-until-you-read-this-4b26b5c44877?sk=e500c2f16403d634ff8a4ea17d705252 https://freedomben.medium.com/centos-is-not-dead-please-stop...
- ikiris 6y agoSaying this repeatedly does nothing to make it actually true.
- freedomben 6y agoI agree! Saying it's false repeatedly likewise doesn't make it false. Where am I wrong? Can you point out my error and make a case for your position? What makes you think RHEL is still "stable" but suddenly a distro a tiny bit ahead is now wildly unstable?
- ikiris 6y agoGo be a child somewhere else. Your responses show a clear lack of understanding of the point of using CentOS and becoming petulant when someone calls you on it just makes it worse. CentOS was binary compatible because the point was expecting it to be the same environment for application layer and testing. The change being described throws all that in the trash and its intellectually dishonest at best or just obtuse ignorance at worst to "misunderstand" the difference here, and how big of a change switching to a "Beta" effect release schedule is when there was an existing 10 year commitment to release schedule that was also thrown in the trash. Don't try to insult the userbase by then gaslighting after the fact.
- detaro 6y ago> but not all that much (yes, really). Cutting 8 years(I think? have something like 2029 in the back of my head) of support from the thing a bunch of people just moved to, with no publicized plan what they'll have to move to instead in the next months(?), doesn't sound like "not all that much" for the kind of environments I've seen CentOS in. What's the plan for them?
- freedomben 6y agoThis is actually the big area where I think the criticisms are right and fair. Dropping 8 years was uncool. Moving to Stream is an option immediately (see post[1] for more information about how CentOS is NOT unstable or "the new Fedora" or whatever else everybody is saying), but there are also forthcoming announcements about new free RHEL subs for individuals and edu institutions and the like. I don't know anything about those. I personally think it was terrible to announce the CentOS changes without those to accompany, but hey if I ran things everything would be perfect :-D [1]: https://freedomben.medium.com/centos-is-not-dead-please-stop-saying-it-is-at-least-until-you-read-this-4b26b5c44877?sk=e500c2f16403d634ff8a4ea17d705252 https://freedomben.medium.com/centos-is-not-dead-please-stop...
- ikiris 6y agoDon't care. Nothing I run will ever run a red hat product again, and most of the people I've talked to feel similar.
- detaro 6y agoThanks. Luckily not my personal problem (or if it is nobody has told me yet...), but knowing how much hassle goes into any major upgrade (even if it's smooth sailing technically) in places with overly conservative processes, I hope those paths and changes get clearly communicated.
- freedomben 6y agoTotally agree. This has the potential to be a nightmare of epic proportions. I strongly wish Red Hat hadn't done that. At the same time if you take any piece of free (as in beer and speech) software and don't pay a vendor promising support, you are kind of taking a risk that whoever is doing work for you for free might decide to stop. In no way does that take Red Hat off the hook here, but it is something I consider. I've got a non trivial migration myself to handle before next December. Depending on how well Stream goes in my testing (so far it's been flawless but I'm not totally done with testing yet) and depending on what RH announces next month (or two), I may be cursing their names next fall ;-)
- ikiris 6y agoGood luck with that position that your customers are wrong and you didn't just fuck them all over (even the paying ones). You might want to update your linkedin.
- freedomben 6y agoWe call that "shooting the messenger." I didn't do anything to anyone lol. I was as surprised as everybody else when I saw the news (and I know you didn't read my blog post now btw because I discuss that in there). If shitting on some person on the internet makes you feel better, by all means take it out on me.
- helen___keller 6y agoI appreciate the blog. I was pretty alarmed by the announcement, and I think as you mention a lot of it boiled down to that devilish-sounding line: > If you are using CentOS Linux 8 in a production environment, and are concerned that CentOS Stream will not meet your needs, we encourage you to contact Red Hat about options But, after reading your message I can partially see your point of view, in particular your gist seems to be that in the chain of development, CentOS Stream will sit where RHEL used to be, thus if you believed in RHEL as a boring, stable, reliable OS in the old world then so too should CentOS Stream be a boring, stable, reliable OS in the new one. This logic makes sense, with one exception: this assumes that the standard for release quality remains unhindered pre/post swapping the position of RHEL / CentOS. Before, Red Hat was incentivized to make sure RHEL releases were solid gold because paying customers were on the receiving end. CentOS releases were downstream of solid gold, making CentOS solid gold as well. Now that the positions are reversed, what incentive does Red Hat have to make sure things are stable and low-risk before shipping to CentOS Stream? This is ultimately a matter of trust: if CentOS Stream gets a bad release, no paid enterprise server explodes. Quality no longer aligns with profit motive, a terrifying insight.
- freedomben 6y agoThanks for the response, and thanks for reading. You make a terrific point: > This logic makes sense, with one exception: this assumes that the standard for release quality remains unhindered pre/post swapping the position of RHEL / CentOS. I don't really have an answer for that. It does seem like it would come down to "trust" and as a skeptical person I don't like that very much. As I think about it more, while we have realigned some economic incentives for the better, it does seem (in addition to your points) there might also be an "incentive" to break CentOS from time to time, just to remind enterprises who are using it that "RHEL" is the gold standard and CentOS is "unsupported" D-: Knowing Red Hat and many of the volunteers that work on these projects, I would be shocked (and indeed would quit my job immediately) if such a thing were to happen, although it would be hard to prove. That said such a thing would no doubt backfire. There would be outrage of course, and it would hurt the CentOS brand (which also hurts RHEL since these days the two are inextricably linked). We all fully expect another distro to "take the place" of old CentOS as a bug-for-bug rebuild (I'm excited about Rocky Linux personally) so not will there still be an option for that, but competition is great for quality of projects :-D Anyway, much appreciate the comment :-) I'll keep mulling it over as well.
- lantastic 6y agoThanks for the blog post. Ep383 of the Linux Unplugged podcast [1] also went into detail with CentOS members. What CentOS gave you until Stream was (with some delay) the "same" set of packages that RedHat released in RHEL, which was (hopefully exhaustively) tested by RedHat QA, including making sure that packages interact in a sane way. That's what earned RHEL (and by extension CentOS) that designation of stability. By virtue of being upstream, CentOS Stream could have a lot more updates (the kind that would previously be internal to RedHat). I doubt same level of QA can/will be invested for each update state (if it could be, RHEL would probably be a rolling distro). If you don't have a QA safety net of your own, the risk is higher with Stream vs 8. You could hack point releases into Stream: wait for RHEL release, then dnf versionlock Stream packages to the same release versions as RHEL (assuming you can map versions of modular packages). [1] https://linuxunplugged.com/383 https://linuxunplugged.com/383
- znpy 6y ago> CentOS is changing, but not all that much The lie detector said that is a lie.
- wfuser 6y agoI see that you note in your profile that you work at Red Hat. May I ask in which department of Red Hat? The reason I ask that is, are you part of the decision making team which made this decision? If not, then no matter how good you think the intentions of Red Hat management here are, I can assure you that they haven't been made for the betterment of the CentOS community. If this was anything to do with the betterment of the community then this wouldn't have been a sudden announcement but instead would have been a long drawn discussion involving the community. I don't say this just for the sake of it, but I have closely followed how they killed the JBoss application server community and the project, as I note in my other comment[1] and this whole CentOS announcement is exactly on similar lines. I have known people in the application server team, who initially tried to justify the whole process, just like you are doing it now for this CentOS "migration", but even they have now realized there wasn't any truth to it. It's not a co-incidence or an accident that the messaging around the community side of this CentOS announcement is confusing and unclear (they are letting the community members try and decipher what this all means for the CentOS project) instead it is intentional. The bottomline, just like in that other case, is that the sales team at Red Hat cannot justify the hundreds of thousands of dollars they ask for supporting RHEL, when customers (or prospective customers) note that they can get the same quality from CentOS (stable release, regular bug fixes, community help). [1] https://news.ycombinator.com/item?id=25358847 https://news.ycombinator.com/item?id=25358847