5 ms·
>The root of the F-35 program's problems is a cost plus style contract that gave Lockheed every incentive to overrun I’m fond of the saying “once you understan
by bumby 6y ago
>The root of the F-35 program's problems is a cost plus style contract that gave Lockheed every incentive to overrun
I’m fond of the saying “once you understand people’s incentives, you understand everything” as it applies to contracting.
I will add, however, that fixed price contracts have their own problems as it relates to cutting corners. E.g., it can put downward pressure on retaining talent and performing best practices because it incentivizes under-bidding and then cutting corners to make a profit. E.g., “you cobbled together some VBA in a spreadsheet once 20 years ago and will work for pennies? Congratulations, you’re our new head of software development!”
A lot of the problems can be attributed to poor contract/spec management and poor oversight. Part of the key is having good requirements and also the contractual teeth/intestinal fortitude to hold contractors feet to the fire
- HelloMcFly 6y agoThis is quite similar to one of my favorite saying that comes from my background in psychology: "When the mouse presses the lever, don't blame the mouse."
- myself248 6y agoOooo, that's profound. I ran across an interesting one earlier, understanding Maslow's Needs by negative example: We usually say that, when someone has food and shelter and safety, when they have friends and feel a sense of belonging, they can pursue higher stuff. And we know at some level that if someone is starving, they will do anything to find food -- civilized behavior goes out the window in that mode. But we forget that if someone has no friends and doesn't feel a sense of belonging, they will also stop at nothing to rectify THAT. Suddenly so much conspiracy stuff makes sense.
- goatinaboat 6y agounderstanding Maslow's Needs by negative example Those are usually called “hygiene factors” in the literature.
- blaser-waffle 6y agoAye, the most common I've seen being 2-factor hygiene approach to HR & Retention. "Hygiene" for the record has nothing to do with deodorant, at least not per se, but instead the willingness to remove negative traits. However, just because you remove negative traits doesn't mean you have any positives. Just cuz you took a shower this morning, wear clean clothes, and trim your fingernails doesn't mean you're not an asshole, and that we should friends with you. Same deal with jobs, cultures, etc. The work may be risky and dangerous, but if there are enough positives to outweigh those negatives, people might stick around. But even if you strip out the negatives, people will eventually float away from jobs that aren't fulfilling or that don't offer any positives.
- JamesBarney 6y agoFor the other side "No, it’s not The Incentives—it’s you" https://www.talyarkoni.org/blog/2018/10/02/no-its-not-the-incentives-its-you/ https://www.talyarkoni.org/blog/2018/10/02/no-its-not-the-in...
- bumby 6y agoInteresting read, thank you. There’s a distinction to be made between excusing bad behavior, but rather they explaining it. The article seems focused on the former, I’m more interested in the latter. There are intrinsic and extrinsic incentives. I think the important part not touched upon is that for those actors extrinsically motivated (e.g., status, money, etc.) the system incentive will influence behavior much more than those more affected by intrinsic motivations. The article is right that extrinsic motivations don’t excuse immoral behavior but when morals are lacking external controls are still needed. Developing the right extrinsic incentives provides guardrails for those who tend to lack intrinsic motivation that align. The article seems to think the solution is to “just act morally” which works at the individual level but that’s not really a policy at a system level (especially once we acknowledge everyone doesn’t share the same goals/motivations/morals)
- HelloMcFly 6y agoI don't really see it as "the other side". Identifying root cause of behavior is critical to modifying it. The "don't blame the mouse" saying is simplified; scientists (as in this article) live in a more complex world. Just because we can understand what led to a set of behavior for scientists, or others, doesn't mean they have no accountability for their actions, but it usually does mean there is a systemic problem that requires a systemic solution, otherwise we'll only ever be treating the symptoms.
- garmaine 6y agoThat's not a problem with fixed price contracts so much as selecting the lowest bidder. An agency which is allowed to pick the more expensive contract that is justifiably better usually won't succumb to these problems.
- bumby 6y ago“Best value” can be very hard to get approved when lower bids exist. Circling back to the incentive theme, I have a feeling contracting officers are graded, in part, by how much they “save”. (In quotes because you can often pay much more in the long run by selecting the lowest bidder). I’ve found people are very risk adverse in this regard and would prefer to select the lowest bid instead of potentially defending their decision during a protest.
- zie 6y agoI think it all depends on your local purchasing department(every govt agency/department gets their own, pretty much). Our department's attitude can be summed up(by me) as: select the best solution to meet your needs, mostly irregardless of cost, but be sure you can articulate why you are buying from A. I.e. You can pick whatever vendor you want, provided you are happy to stand up, under oath, in court and talk about WHY you selected vendor A over vendors B, C and D. So far so I have no experience in court defending our choices.
- zie 6y agoAnd those of us that spend govt money generally do this, it's totally fine to not pick the cheapest, you just have to have a sound reason to do so. I.e. if you aren't willing to stand up in court and talk about why Tootie is better than Tito, despite Tito being 10% cheaper, you better be selecting Tito or looking for another job.
- garmaine 6y agoThanks for offering your experience. That matches with my own as well, albeit from the other side. I worked for a large government contractor on our bid, and we knew we weren't going to have the cheapest option but rather banked on the value-add. And most of the time it worked.
- adinb 6y agoFirm, Fixed Price (ffp) contracts can be utilized with incentives after delivery based on metrics like tail availability, maintenance issues, flight hour cost, effectiveness, etc. Most big contracts are really a hybrid, though an existing contractor always tries for a cost plus. It's literally taught in PM classes. I was NOT directly involved in F-35, so I can't speak to the exact amount of sleaze that occurred with the prime contractor. I'd love to see a real competition! (new contractors, new ideas, new teams, new airframe ideas). And two engines, yeesh. Anyways, cost plus is great at moving risk to the government. FFP is at the other end of the spectrum, moving all risk to the contractor. [Unnecessary edit: I'm a fan of the textron scorpion-as a light attack fighter we could modify]
- rsj_hn 6y agoI think the issue is if you are going to order a million toilets, then moving all the risk to the contractor is fine. If you are asking for innovation and R&D, then the contractor already has a ton of risk. Add in requirements to make a fighter suitable for all branches of the military, and the risk is gigantic. In that environment, you need to remove risk from the contractor. This is why R&D projects can't be treated in the same way as delivery of well understood tech that simply needs to be mass produced well and efficiently.
- caoilte 6y agoSo don't do it fixed price but do cap allowable profits to 3-5% or so. That was how Apollo program was run.
- rsj_hn 6y agoOK, but that's still a cost plus contract. I don't think the size of the percentage in the "plus" is what explains the failure of the F35.
- austhrow743 6y agoYou’re creating a situation where the only way they can increase profit is to increase total spend.
- SCAQTony 6y agoI am not trying to be a smart ass but how about this for an human incentive: Build us plane that fulfills these outlined objectives, that meets are budget requirements, or we will shop somewhere else.
- bumby 6y agoI get what you’re saying but I wish it were that easy. Take the requirements for example. If they aren’t airtight, you’ll get into a wordsmithing scenario where the contractor claims they met the requirement and it becomes a game where the team with the best lawyer wins. Write the requirements too explicitly and contractors will push back saying “tell us what you want, not how we’re supposed to do it.” A somewhat silly example is if you specify you want unit testing on all safety critical code paths a contractor may claim they define running a compiler as “unit testing”. A contracting officer may not be technically savvy enough to push back and when the subject matter experts try to leave negative contract comments (that get reviewed when awarding future contracts) they get scrubbed because its not worth the fight in the eyes of the contracting officer. Unfortunately, just saying “do good work” just doesn’t...work
- SCAQTony 6y agoThank you, my ignorance on the subject has summarily changed
- blaser-waffle 6y agoAnd the parent's comment is any contracting work, really. With DoD you have to add in various accountability steps, political footballs, public opinion, etc. If you've spent time around the DC area you'd be shocked at the number of adverts for things like the F-22 that you see. One time I took the metro from NoVA to MD, with a stop off downtown, and counted at least 6. They're not just bringing lawyers and playing contractor games, they're aggressively marketing to everyone.
- mekkkkkk 6y agoHaving only been to the US a few times I'm floored by this. You mean to tell me that there are actual printed ads in public places for _fighter planes_? I can sort of understand the rationale in DC, but it just seems surreal to me. Those kinds of purchases being swayed by subway ads... I really hope it's a joke.
- darkteflon 6y agoIncentives seem to have huge explanatory value wherever you look, don’t they. I’d like to add a classic Warren Buffet quote into the mix: “Show me the incentive and I'll show you the outcome.” Does anyone have any views on what constitutes canonical reading on incentives? Some of the classic game theory works? Would love to hear opinions on this.
- N1H1L 6y agoIncentives in my opinion leads to Goodhart's law [1]. In fact, I will go a step further - most incentives are chosen by well meaning people. There is neither malice nor incompetence going on. What happens is that every incentive can be perverted, and will be perverted over time. Over time, then that incentive, that was once chosen with good intentions, becomes perverse. [1]https://en.wikipedia.org/wiki/Goodhart%27s_law https://en.wikipedia.org/wiki/Goodhart%27s_law
- bumby 6y agoIncompetence may be too strong of a word but I think there can be a lack of thinking about second and third order effects when the “measure becomes the target”.
- rstuart4133 6y agoI've never heard of Goodhart's law. To save others clicking on the link, it's: > When a measure becomes a target, it ceases to be a good measure. In my experience, it might actually be a useful approximation of reality.