5 ms·
Southwest’s meltdown from a pilot’s perspective
- coryfklein 4y agoI love the commentary about investment in operations. They hire a finance-oriented CEO who doesn't invest in building out tooling and infrastructure. This was the key paragraph for me: > But as time went on the operation began to deteriorate. There was little investment in upgrading technology (after all, how do you measure the return on investing in infrastructure?) or the tools we needed to operate efficiently and consistently. As the frontline employees began to see the deterioration in our operation we began to warn our leadership. We educated them, we informed them and we made suggestions to them. But to no avail. The focus was on finances not operations. As we saw more and more deterioration in our operation our asks turned to pleas. Our pleas turned to dire warnings. But they went unheeded. After all, the stock price was up so what could be wrong? I see this in tech all the time. It is indeed very hard to measure the return on investment for tooling and infrastructure in tech! Any infra work, whether it's splitting up your monolith into components, improved developer tooling, or fixing flaky builds has a vague and hand-wavy return on investment and has to compete with "Well customer FooBar will sign a $10M contract in Q2 if we build feature BashBaz instead," and now good luck as an engineer explaining how and when exactly your investment in developer tooling is going to make the company $10M in Q2. But if you never invest in these, then the machine comes to a grinding halt and everyone's hair is on fire, and there is no quick fix because the solution was to invest in the problem proactively starting 2 years earlier, and now that you're so late it's going to take 4 years to solve the problem because you have to first deal with all the debt you accrued. This is a place where leadership really can have 100x impact by establishing a dual-route for evaluating projects. The first route is the traditional "how much money will this make us", but the second is based on principle ignoring $$$ returns, "what is the most impactful operational improvement that our front-of-the-line staff is recommending?" You have to simultaneously run both strategies!
- Eisenstein 4y agoIt is impossible to quantify 'how much more money we made because nothing broke because we invested in making sure that didn't happen', and if it can't be quantified then for an MBA-type it doesn't exist. If it can be quantified, then it is now a goal to be reached and it better improve every quarter. This is good for certain kinds of businesses, like consumer goods, but terrible for others, like airlines and services.
- bob1029 4y ago> You have to simultaneously run both strategies! Agreed. I really see no reason you can't do this at any scale. We do it today in our tiny startup. The strategy we employ is a little different - Some of us "secretly" work on product iterations so as to not distract the rest of the team until we are sure we've found something. If the new work doesn't pan out, no one even hears about it. If it's amazing, we sort out a gradual introduction of the idea to the team. There is no reason you have to have 100% of the organization bought into a rewrite/refactor/iteration of the product. All it takes is for one or 2 strong employees to go off into the dark forest for a while and come back with a potential prize. For an organization as large as Southwest, this would be a negligible cost even factoring in their razor-thin operating margins.
- caleb-allen 4y ago> All it takes is for one or 2 strong employees to go off into the dark forest for a while and come back with a potential prize. I wish there was a more prevalent culture! My most productive work comes about this way, and I've yet to find a job where I'm able to do this regularly.
- everforward 4y ago> good luck as an engineer explaining how and when exactly your investment in developer tooling is going to make the company $10M in Q2. My experience is that most engineers don't try, because they don't tend to speak finance. A lot of developer tooling is roughly quantifiable; this tool saves X minutes while doing Y, do a little survey to see how often people do Y, multiply Y and X to get time saved per year. Divide X*Y by the number of work minutes in a year, and you have the number of man-years saved. Multiply that by the average salary of an engineer, and that's very roughly how much the dev tooling is "worth". It's not a precise answer, because 50 employees saving a couple hours of time a week isn't the same as having another employee, but it's a workable approximation. > the solution was to invest in the problem proactively starting 2 years earlier, and now that you're so late it's going to take 4 years to solve the problem because you have to first deal with all the debt you accrued. This can also be roughly quantified. Get rough numbers on the resources required to fix the problem now. Look at what's coming for the next year or two in terms of projects and infrastructure that will exacerbate the issue, figure up roughly how much effort it will take to fix those. Convert that effort number into salaries, and you have a rough idea of what the cost of delaying the fix is. If you're worried about tech debt causing a catastrophic failure, figure out what that scenario looks like, calculate up the concrete costs of the failure (SLA violations, refunds, etc), then have another column for potential costs like regulatory fines, and a third column for things that have costs that the finance people are better suited to handle (what's the cost of reputation loss?). Again, it's unlikely to be completely accurate, but it gives you a data-based platform to speak from. Even better is to engage the finance department to help draw up those numbers. Money is their forte, and calling them in to help with money questions is the same as calling in the frontend people to help with React or whatever. I think sometimes we engineers spend too much time around other engineers and get too comfortable speaking in terms of engineering priorities. Those don't extrapolate; finance and legal don't give 2 shits about "flaky unit tests". We have to convert those engineering priorities into other teams' priorities if we want them to care. Finance cares about money, so rephrase the engineering problem into a money one. Legal cares about liability, so rephrase the problem into a liability.
- matthewdgreen 4y agoThe measure of a good CEO is their ability to oversee an operation that “doesn’t speak finance” and/or to staff the executive ranks with people who can translate priorities into terms that can be reasoned over financially. When a company fails to do this the blame lies with the executive leadership, not the operational employees on the ground. This is supposed to be the reason executives are well-paid.
- inferiorhuman 4y agoI love the commentary about investment in operations. They hire a finance- oriented CEO who doesn't invest in building out tooling and infrastructure. I don't. As bad as Gary is, he inherited a mess. One of the Southwest (computer, not meatspace) ops guys posted to reddit about how dysfunctional things are. That doesn't happen overnight. A former Southwest pilot posted an indictment on another forum. Some of the best bits: Instead of pulling bag carts up to planes with a tug....you had to PHYSICALLY pull them up to the plane. They did not scan luggage and MOST WN workers were against getting scanners because they felt it would take jobs. Hand counting bags, freight and mail in 2017 !!!! They don't have load planners. So they use a bungee cord at the cat and an ops agent lowers it down to the Ramp agent. Herb enjoys a cult of personality, but Southwest outgrew their britches decades ago. Aside from being a toxic little shit, Gary's biggest problem is that he didn't change much. If they're still managing bags manually then dealing with the backlog of luggage is going to be the most painful part of this whole meltdown. Potentially months until some people see their luggage again.
- MuffinFlavored 4y agois it as simple as “let’s blame this CEO as an outsider for a binary yes/no good/bad overly-simplified decision?” do we have proof this CEO declined any attempt at internal investment in tooling/infrastructure? is he solely to blame? why did a board of directors/shareholders/C-level executives stand by and let this happen? how can everybody be making $400k/yr-$20m/yr and be level 101 “summarize it in a one sentence” incompetent?
- tadfisher 4y agoOf course it's not that simple, nothing is. The truth is that this situation has evolved over 20 years. The former CEO didn't say on their first day, "we shall invest no more in operations and infrastructure", but they made a series of decisions over those 20 years, some small and some large, which had the net result of de-emphasizing operations and emphasizing finance. The board sees operational expenses as a line item on a slide, they don't see the complaints from front-line workers or middle management. Infrastructure is one of those things that either works fine or fails catastrophically, and you need a series of those catastrophic failures to show a dent in the quarterly/YoY results, so it's unfortunately also easy to ignore if your metrics are finance-oriented. You can also get into a culture spiral, similar to what is happening at Boeing, where the management is gradually replaced with folks who focus on financial results and promotable metrics. This is ultimately the CEO's responsibility, but they need to install the right folks at the higher levels to fight against this tendency.
- MuffinFlavored 4y ago> but they made a series of decisions over those 20 years, some small and some large, which had the net result of de-emphasizing operations and emphasizing finance. I just don't like to believe that something as sophisticated as a $20b company can be boiled down by over-simplified observations you and I make from the comfort of our desks. There's got to be something more complex. https://www1.salary.com/Robert-E-Jordan-Salary-Bonus-Stock-Options-for-southwest-airlines.html https://www1.salary.com/Robert-E-Jordan-Salary-Bonus-Stock-O... CEO is making $3m/yr and you and I are supposed to be able to detect his weaknesses/mistakes/pitfalls at the blink of an eye? If it was that easy, why don't they just "not make that mistake" and fix the problem?
- 908B64B197 4y ago> Our pleas turned to dire warnings. But they went unheeded. After all, the stock price was up so what could be wrong? Wonder how many software engineers at Southwest immediately sold their vested shares and bought real tech stocks (like FAANG). They must be laughing right now!
- wikibob 4y agoI would be very very surprised if Southwest gives shares to software engineers.
- mindcrime 4y agoI see this in tech all the time. It is indeed very hard to measure the return on investment for tooling and infrastructure in tech! Any infra work, whether it's splitting up your monolith into components, improved developer tooling, or fixing flaky builds has a vague and hand-wavy return on investment and has to compete with "Well customer FooBar will sign a $10M contract in Q2 if we build feature BashBaz instead," and now good luck as an engineer explaining how and when exactly your investment in developer tooling is going to make the company $10M in Q2. I agree that it's hard to quantify those kinds of things, but I might quibble over the degree of difficulty. At the very least, some techniques for dealing with these kinds of "hard to quantify" scenarios are known, published, and have been analyzed to varying degrees. For a company the size of SouthWest, with the amount of money that's at stake, I find it surprising that they wouldn't use such methods (or maybe they do and just still managed to screw the pooch, I don't know). What means am I talking about? Well, you could start with by the book Scenario Planning[1], and then have domain experts assign costs to different scenarios and use calibrated probability estimation[2] to assign probabilities to those scenarios. And then you could use Monte Carlo simulation[3] to get an idea of the likely distribution of outcomes. From there you can calculate a range of likely costs (or returns, depending on which way you frame the problem) for dealing with, or not dealing with, specific scenarios. This is a very high level and hand-wavy description, btw, of the methodology Douglas Hubbard[4] lays out in his book How to Measure Anything[5]. [1]: https://en.wikipedia.org/wiki/Scenario_planning https://en.wikipedia.org/wiki/Scenario_planning [2]: https://en.wikipedia.org/wiki/Calibrated_probability_assessment https://en.wikipedia.org/wiki/Calibrated_probability_assessm... [3]: https://en.wikipedia.org/wiki/Monte_Carlo_method https://en.wikipedia.org/wiki/Monte_Carlo_method [4]: https://en.wikipedia.org/wiki/Douglas_W._Hubbard https://en.wikipedia.org/wiki/Douglas_W._Hubbard [5]: https://www.amazon.com/How-Measure-Anything-Intangibles-Business/dp/1118539273 https://www.amazon.com/How-Measure-Anything-Intangibles-Busi...
- MisterMower 4y agoI suspect a lot of CEOs want to make these investments but are unable to convince key players and shareholders to get on board with doing so. Persuading key players is work, you have to spend reputational capital, twist arms, and the process consumes time and resources needed for other important company objectives. It’s easier to wait for them to fail so that it’s abundantly clear to everyone that they need upgraded and improved, and everyone is instantly on board with doing so. Yeah, you take some heat in the immediate aftermath but in the long run it’s probably cheaper and less risky all around. Alternatively, those systems may never fail, or take a long time to do so. it makes counterintuitive business sense.
- sghill 4y agoThis 2006 Stanford interview[1] with Kelleher sounds like taking ideas seriously was an important part of the culture. Tragic it was lost, as it always stuck out in my mind as an example of great leadership. > Southwest continues to encourage and applaud out-of-the-box thinking from everyone at the company, from flight attendants to top-level executives. He recalled one mechanic, for example, who submitted a sketch showing how to fit an extra seat onto the aircraft, in order to compensate for some over-wing exit seats lost due to a new federal air safety regulation. > In general, Kelleher said, if a Southwest employee submits an idea like that, he or she can expect to get an answer back within a week, and a lengthy explanation to boot. The point, he said, is “never spoil an idea, because when you spoil an idea, you ensure that you’ll never get another one from that person.” [1]: https://www.gsb.stanford.edu/insights/herb-kelleher-manage-good-times-so-youll-do-well-bad-times https://www.gsb.stanford.edu/insights/herb-kelleher-manage-g...
- medyassine2 4y ago[flagged]
- medyassine2 4y ago[flagged]
- stcroixx 4y agoThey go out of business. Leadership gets new leadership jobs somewhere else. Pattern continues as long as leadership doesn’t face serious consequences. There are no long term businesses anymore, not past a couple quarters. MBA programs are the organized crime of this era. MBAs make out greatly fleecing investors and employers. How long this bullshit remains legal is up to us. Both parties support this and will continue unto we hold them accountable. We’re falling for their distractions over trivial matters. Of course this is in no way specific to the airline business. Are funds the problem? Has investing just become too abstract yet essential for me?
- nayuki 4y agoHow did the poster manage to get a numeric FBID for this post (#10229509585826782) instead of the more common, time-varying pfbid blob?
- deleted 4y ago[deleted]
- ilaksh 4y agoThis type of thing is one reason I prefer to work for myself on my own businesses even if it means I am broke. It's very hard to have people who are irresponsible, cognitively and ethically inferior running your life. I truly believe that is what is going on. Many executives succeed on a quarter-by-quarter basis based on their ability to schmooze and fix the numbers. They actively avoid addressing thorny problems because they are irresponsible and don't know how to solve problems and know they can probably get by to the next quarter.
- Alderman22 4y agoHonestly i really don’t know what would have become of me if not for ROOTKITS RECOVERY CENTRE who has been of grate benefits to me and my family. its was my first time investing in Binary company, i got introduced to this company through a Lady i had met on instagram, we actually have been friends for almost a year over on instagram. along the line she mention about this company to me and how she had been earning money from there and did provide me with some sort of proofs and certificate of the company. then i went ahead and made a couple of investment with them, but when it was time for me to withdraw my total profits and earnings, they started giving silly excuses regarding the company upgrade, taxes and co as was unable to make the withdrawal successfully. the support was not helping out in anyway as they kept requesting for more money, while all this was happening personally i got really disturb and depressed, a friend of mine who i opened up to in order to lend some money so i could at least pay the fees and have my funds but he then told me that this could be scam that he had a similar experience and advice i should get a hacker which he referred me to Rootkits. left to me i never believe that could be possible but as it goes i contacted their email: R O O T K I T S 4 @ G M A I L . C O M , They responded once and i gave him the necessary info they required. to my great surprise he recovered all my investments back for me just within few days i couldn’t be more thankful, If you have been a victim of crypto or binary scam you can trust Rootkits. I thought there were no such good genuine guys anymore on earth, but this team brought my trust to humanity again. GOD bless you Rootkits you can reach him on Telegram ( ROOTKITS7 )