8 ms·
You have to fail to move forwards. A lack of failure is a sign of a lack of trying anything new. Hasn’t SpaceX proved that? The negative commentary around thi
by tailspin2019 6y ago
You have to fail to move forwards. A lack of failure is a sign of a lack of trying anything new.
Hasn’t SpaceX proved that?
The negative commentary around this seems a little in contrast to how we’d talk about a SpaceX “failure” on HN.
I know NASA and SpaceX are very different, but Elon is the king of drifting deadlines too. And SpaceX do fail, but they do a good job of “owning their failures” and they keep moving forwards.
Should we cut the NASA team a bit of slack?
Let’s not forget also that it’s NASA who have also drastically changed their strategy and have enabled private companies like SpaceX to shine through their partnerships.
NASA is big, wasteful, bureaucratic yes, but they are changing, slowly... and this “failure” is not the stick I’d choose to beat them with.
- mcbutterbunz 6y agoI don’t mind failure and I understand there are going to be setbacks. I just wish they would fail faster. I love NASA and all they’ve done but 10 years of SLS without a launch makes me doubt this thing will ever get off the ground. With a new administration, I feel like we’re one setback away from the whole thing being cancelled.
- tailspin2019 6y ago> I don’t mind failure and I understand there are going to be setbacks. I just wish they would fail faster. I do agree with this. I just took issue with the lede being “rocket test fails” as if that’s a bad thing. The underlying points are all valid, speed, cost etc but a failed test is not the thing to be focussing the argument on in my view.
- maccam94 6y agoSLS proponents have been claiming that all of the extra time and money spent on process and formal verification would lead to a rocket that works without having to do lots of trial-and-error like SpaceX. Heck, even the name of the test campaign, the "Green Run," kind of reflects this hubris and shows that NASA expected the tests to largely be a formality.
- jbay808 6y agoDoesn't a green run refer to a beginner level course? Like a practice ski hill?
- maccam94 6y agoI didn't realize there was any other way to interpret it besides "getting green (successful) results for all of the tests" (there are 8 test stages planned). I think we're both wrong though: "The term “green” refers to the new hardware that will work together to power the stage, and “run” refers to operating all the components together simultaneously for the first time." --https://www.nasa.gov/exploration/systems/sls/green-run-test-paves-way-for-nasa-moon-missions.html https://www.nasa.gov/exploration/systems/sls/green-run-test-... I still think these tests should be run more than once though, the RS-25's were originally reusable anyway.
- ElFitz 6y agoTrue, but they are failing very, very, slowly. The big difference between NASA and SpaceX lies in how fast they each move, and what they are failing at. Failing at launching the first private rocket on a tight budget, at landing a rocket for the first time, or at iterating on rocket designs at pace rarely, if ever, seen before is expected. As a matter of fact, it’s success that isn’t expected. Failing at making yet another (very expensive) rocket built by supposedly experienced manufacturers overseen by a huge public organisation over more than a decade with huge funding? Well, it’s a bit disturbing to say the least.
- pfdietz 6y agoSpaceX learns by doing, not by years of expensive analysis that ends up not preventing failure anyway. SpaceX's approach also deals with the real problem, which is a program having the wrong goals, rather than making mistakes in working toward a given goal. How many of you have built a product that ended up working great, but was a failure because it was the wrong product?
- deleted 6y ago[deleted]
- tailspin2019 6y agoWaterfall got us to the moon. Agile will get us to Mars...
- MichaelMoser123 6y ago'Daily standups on Mars' that would make an epic show.
- mumblemumble 6y agoLore suggests that that's a misconception, born of the Agile myth that the only thing that existed before the invention of either XP or Scrum was waterfall. The truth is perhaps more like this: agility got us to the moon, bureaucracy trapped us in low earth orbit, agility seems to be offering our best hope at getting back out of LEO again, including to Mars. For example, see https://www.computerweekly.com/news/2240112230/Interview-From-Apollo-Mission-to-agility-manifesto https://www.computerweekly.com/news/2240112230/Interview-Fro...
- tw04 6y agoI don't think the negativity is directed at NASA so much as Boeing. They've made a business out of grifting, and this is just another example of it. Shelby is more concerned with staying in office than making advances in space, and it shows. That's not NASA's fault, they're trying to do the right thing IN SPITE of the political pressure to waste money in order for a politician to be able to claim he's "creating jobs" in his state. http://innerspace.net/congress-2/richard-shelbys-war-against-spacex/ http://innerspace.net/congress-2/richard-shelbys-war-against...
- ryandrake 6y agoNASA probably could be as nimble as SpaceX if they didn’t have to rely on Congress, whose goal is not to build a successful rocket, but to spread the money funnel across the States. Imagine if SpaceX’s board suddenly said “the company’s goal is now not to get to Mars, but to employ as many people and contractors as possible in all 50 states!” You’d basically get NASA.
- beerandt 6y agoSo basically... government could be as efficient as the private sector if it wasn't government?
- mjevans 6y agoIt could be a lot more efficient if they stopped trying to be subtle and instead spent more time thinking. Openly admit NASA is a basic infrastructure assurance program, much like the Interstate highway system is. (Yes, it's Military capable infrastructure, for moving troops and stuff around. It turns out that useful infrastructure improves overall economic fitness and activity as well.) Then group up all of the infrastructure spending and make sure it gives every citizen roughly equal value. Sometimes this can be justified in lower shipping costs for produced items from farms and backbone redundancy across the country. Other times it's connecting land and sea ports to the cross country grid. Evaluating a fair share of the commons and of resources to maintain the commons is a hard problem. NASA also falls under various civic services the government proves because it makes sense for just one place to do the work; or at least for a baseline that private entities can compete against. The distribution of these programs also forms part of the weight to balance government improvements programs among areas.
- mumblemumble 6y agoMy impression is that the big difference between NASA's human spaceflight program and SpaceX is that, where NASA has failures, SpaceX has stretch goals that weren't met. This is an unfortunate consequence of any insufficiently iterative development process.
- akira2501 6y ago> Let’s not forget also that it’s NASA who have also drastically changed their strategy and have enabled private companies like SpaceX to shine through their partnerships. That's because they're required to by law. There's an entire section of the United States Code that's dedicated to this.
- GuB-42 6y agoSpaceX made failure part of its strategy. Rocket explodes, no big deal, we expected that, the next one is ready. NASA is not like that, they are more conservative, spend a lot of time and money making sure things work the first time, so when they don't, then it is a problem. This, BTW, is one thing that killed Armadillo Aerospace. > Carmack said another mistake the company made was not to go into series production, making several versions of the STIG rockets simultaneously so that the loss of a single vehicle would not be as traumatic. “That was our critical mistake in the last few years, because we should have been able to put more of these together,” he said. It is not that NASA doesn't have the right to fail, but in their case, it is a major setback, and it is a bit disappointing considering how much SLS went overboard.
- dmix 6y agoWasn’t this simply a byproduct of Congress trying to control the process? The idea of hard deadlines and low risk. Apparently they only have until Feb to try to test it again to make sure they can launch this year. That sounds like pure political pressure instead of organizational culture. Congress tried to cancel this whole test to speed things up so they were apparently fortunate to have done this test at all.
- akiselev 6y agoNo, it's a pathological NASA problem. It does involve Congress and the public indirectly, since they're both terrible at statistics and mission failures have a huge impact on NASA's budget. Mission success has diminishing returns at about 80% chance of success so (as an example), NASA can spend $250 million on a mission with an 80% chance or $500 million for a 95% chance. The probability of two $250 million missions failing is 4% but the public only looks at the absolute number of failures instead of absolute number of successful missions or their cost so NASA decades ago learned to err on the side of extreme caution for self survival. This style of risk management has trickled down across the entire agency, compounded by pork barreling, so now pretty much everything NASA does is done as a one off trying to optimize for least number of total failures at the expense of productivity.
- JshWright 6y agoThey are very different kinds of failure though... This was not an exploratory "try something new" test. This was an integration test to verify that all the "on paper" work was correct. The whole point of SLS is that its use of technology with extensive "flight heritage" is supposed to avoid having to break new ground. This is like discovering a major issue during the shakedown cruise of a new ship. It's better to find the issue now, and that's why they test, but the point of this test wasn't to learn anything new, it was supposed to just prove that it works as expected. SpaceX is generally very up front about tests that they think have a high likelihood of failure, and the tests that do fail tend to be doing genuinely "new things" (like belly-flopping a booster). I'm not a SpaceX fanboy here (I think Elon in particular is pretty insufferable), but it's not really to fair to compare SpaceX's development testing failures with this integration test failure.
- TaylorAlexander 6y agoSo I listened to a podcast about this... but SpaceX and Boeing/NASA are explicitly taking two different approaches to proving their rocket will work. Obviously we know SpaceX is proving their rocket through system level tests. But for SLS the plan has been to use a long accepted NASA approved method of proving their design where individual parts are so thoroughly tested and proven to work that they don’t need many flight tests of the full system. In fact I believe the original plan was one flight test without humans and then have the second flight be a manned mission! So they really aren’t supposed to fail like this. So at the core are two different approaches to proving their system, where SpaceX totally expects some failures and SLS is supposed to be proven before it even flies. Personally I’m a fan of the SpaceX method but I can understand why the old guard space developers would choose this slower more cautious method.
- tailspin2019 6y agoWould you mind sharing a link to the podcast? It sounds interesting!
- TaylorAlexander 6y agoI tried to find it a bit but I’ll do a more thorough search to see if I can figure out where I learned this. I’ll let you know if I find it. EDIT: Did a thorough google search and looked through my podcast lists but I haven't been able to find it. I did find this podcast in my listening history which may or may not cover the topic, but unfortunately I don't see a transcript I can search through: https://theorbitalmechanics.com/show-notes/ella-atkins https://theorbitalmechanics.com/show-notes/ella-atkins
- tailspin2019 6y agoAppreciate you looking for it! Will give that episode a listen.
- foobarian 6y agoAdding to your comment, this closing made me sad: "So what had been viewed as a strength of the program, using heritage hardware, instead became a liability. Saturday was only the first real hardware test for the rocket. It cannot afford too many more liabilities like those on display." If anything they cannot afford _not_ to have more failures like that. In fact on the spectrum of failures this one was near the best possible outcome since something was learned without destroying the entire assembly. But with this kind of reactive thinking they may turtle up and slow down progress until the program gets canceled.
- MaxBarraclough 6y ago> A lack of failure is a sign of a lack of trying anything new. I may just have blindspots in my history knowledge here, but the moon landing was pretty much an unqualified success, no?
- tailspin2019 6y agoI'm not sure what point you're trying to make? My comment (in support of NASA) was that an isolated test failure shouldn't be looked upon as a failure of their entire programme. Instead it's actually a signal of progress being made (however slow that progress may be). There were plenty of isolated testing failures like this (some much worse) leading up to the moon landing.
- detaro 6y agoIt did go very well overall, but 3 astronauts died in testing (totally avoidable), several of the test-launches of the rockets didn't go to plan, and later Apollo missions had various incidents.
- pfdietz 6y agoIt was a pyrrhic success. It was so expensive it was a dead end.
- nickik 6y agoIts actually wasn't. If you actually look at the cost involved. Putting all the funding into Shuttle simply made the Apollo architecture to expensive. A much, much, much, much better strategy would have been to keep the Appollo hardware and evolve it. Plan for 1-2 Saturn V flights every year. Use the F1 engine on a smaller vehicle (like Saturn 1B) and use that vehicle as the work horse for both the military and NASA. This would have allowed them to mass produce the engine, reuse the same pads. It would have given them much more capability compared to Shuttle and it would have been considerably cheaper. It was bad engineering choices, not simply the budget. They cut the wrong things.
- pfdietz 6y ago
- HeadsUpHigh 6y agoFailure at NASA isn't like failure at SpaceX. This was the culmination of 10 years of simulations and pork jobs. For SpaceX its the culmination of a couple weeks of wielding on a tent using private money instead of direct public funds.
- nickik 6y agoDifference is SpaceX welded some tanks on a field. This program spend 20 billion over 10 years designing the whole system on paper with very little iterative testing. This not a prototype, this is the actual rocket that should fly. It has already spent over 1 year on the test stand to do 1 static fire. SpaceX did 3 static fire in ONE DAY last week. Consider this, when SLS started development SpaceX Starship literally didn't exist on paper, the engines didn't exist, the facilities they were built in didn't exist, they didn't even have approval to build facilities. So SpaceX designed a totally new engine, a engine mass manufacturing line, multiple new test stands, designed threw many iteration on the Starship design, build a totally new private space port with a huge manufacturing facility. All of this was done for a budget that is less then what SLS gets PER YEAR and not just a little less. One year of SLS development could have likely funded all of SpaceX research and development over the last 10 years. NASA simply should not build its own rocket. And even worse they should not blow unlimited amounts of money into these contracts while they are showing absurdly bad performance. In fact, I think the government should systematically be compensated with stocks of these companies when they go over budget and over time by this amount. The whole program is political, it serves no function. Payloads like Europa Clippers are fighting politically for the right NOT to launch on SLS. Having SLS around forces NASA into suboptimal moon architectures. SLS is a political straight-jacked for NASA. With the SLS budget alone so many amazing project could be funded, it is hard to even comprehend. We can 'cut the slack' on this issue, but the issues keep coming and the rate of delay is pretty crazy and the cost are even crazier. > Let’s not forget also that it’s NASA who have also drastically changed their strategy and have enabled private companies like SpaceX to shine through their partnerships. Fantastic, totally agree. Lets do more of that, and less giving Boeing and LM money for not performing well.