4 ms·

Honestly I've never worked in an environment and with stack mature and scalable enough, with roles within the team so clearly divided, for chaos monkey to be of

Honestly I've never worked in an environment and with stack mature and scalable enough, with roles within the team so clearly divided, for chaos monkey to be of any use. Hectic deployments, "it's not my job" attitude, feature creep, and a litany of minor errors and misconfigurations were taking its place.

jedberg 8y ago
Perhaps if you had introduced Chaos Monkey, those other problems would have gotten solved as a solution to the Chaos (tm). :)
- marcosdumay 8y ago
  If the GP introduced a Chaos Monkey, he would probably get fired by the same people that are not fixing those problems.
  - tomrod 8y ago
    Corporations are groups of people, policies, and technologies. Of these, people are the hardest to work with.
- delusional 8y ago
  I think it was Netflix engineer at a conference that once said that you shouldn't run chaos monkey if you expect it to fail. If you don't think it will work, then go fix those places that you know to be rotten first. Your comment was probably in jest, but it provided a nice platform for mine :)
  - jedberg 8y ago
    It was indeed in jest. And there’s a good chance I was the Netflix engineer who told you that. To be fair though when we launched it at Netflix we knew it would break things. But we also knew we had the corporate will to deal with it.
    - twblalock 8y ago
      > But we also knew we had the corporate will to deal with it. That's really the key. If you don't have that, it's not going to work out in the long term.
- karlkatzke 8y ago
  No. That’s entirely not the way it works. Chaos Engineering works in companies with significant scale and sufficient maturity, and the purpose is to discover design or implementation failures in distributed systems before they happen during big rushes where you’re hopefully making lots of profit. If you lack sufficient maturity or you are not large enough, you will actually lose benefits if you try to implement chaos engineering. It’s like teaching a toddler to use a propane torch. You just don’t do it, or everything you love in the world will burn.
  - karlkatzke 8y ago
    Self reply to realize that I shouldn’t lecture my grandma on how to suck eggs.
    - jedberg 8y ago
      Maybe I should have added a disclaimer with the :) at the end. Thanks for the laugh though. Your phrasing was awesome.
  - empath75 8y ago
    I’m telling you from experience that’s wrong. We did it at a project with just 15 or 20 developers, starting from day one of development. Literally the first thing we installed was chaos monkey before doing anything else, even before getting Jenkins running.
Swizec 8y ago
Yeah I don't need a chaos monkey I've got myself.

jedberg 8y ago

Perhaps if you had introduced Chaos Monkey, those other problems would have gotten solved as a solution to the Chaos (tm). :)

marcosdumay 8y ago
If the GP introduced a Chaos Monkey, he would probably get fired by the same people that are not fixing those problems.
- tomrod 8y ago
  Corporations are groups of people, policies, and technologies. Of these, people are the hardest to work with.
delusional 8y ago
I think it was Netflix engineer at a conference that once said that you shouldn't run chaos monkey if you expect it to fail. If you don't think it will work, then go fix those places that you know to be rotten first. Your comment was probably in jest, but it provided a nice platform for mine :)
- jedberg 8y ago
  It was indeed in jest. And there’s a good chance I was the Netflix engineer who told you that. To be fair though when we launched it at Netflix we knew it would break things. But we also knew we had the corporate will to deal with it.
  - twblalock 8y ago
    > But we also knew we had the corporate will to deal with it. That's really the key. If you don't have that, it's not going to work out in the long term.
karlkatzke 8y ago
No. That’s entirely not the way it works. Chaos Engineering works in companies with significant scale and sufficient maturity, and the purpose is to discover design or implementation failures in distributed systems before they happen during big rushes where you’re hopefully making lots of profit. If you lack sufficient maturity or you are not large enough, you will actually lose benefits if you try to implement chaos engineering. It’s like teaching a toddler to use a propane torch. You just don’t do it, or everything you love in the world will burn.
- karlkatzke 8y ago
  Self reply to realize that I shouldn’t lecture my grandma on how to suck eggs.
  - jedberg 8y ago
    Maybe I should have added a disclaimer with the :) at the end. Thanks for the laugh though. Your phrasing was awesome.
- empath75 8y ago
  I’m telling you from experience that’s wrong. We did it at a project with just 15 or 20 developers, starting from day one of development. Literally the first thing we installed was chaos monkey before doing anything else, even before getting Jenkins running.

Swizec 8y ago

Yeah I don't need a chaos monkey I've got myself.