3 ms·
> I don't get why people hate it. Because it is hard to manage the configuration. It's why tools like terraform exist. Anecdote. I worked for a small compan
by frompdx 6y ago
> I don't get why people hate it.
Because it is hard to manage the configuration. It's why tools like terraform exist.
Anecdote. I worked for a small company that was later acquired. It turned out one of the long time employees had set up the company's AWS account using his own Amazon account. Bad on it's own. We built out the infra in AWS. A lot of it was "click-ops". There was no configuration management. Not even CloudFormation (which is not all that great in my opinion). Acquiring company realizes mistake after the fact. Asks employee to turn over account. Employee declines. Acquiring company bites the bullet and shells out a five figure sum to employee to "buy" his account. Could have been avoided with some form of config management.
- cmckn 6y agoSounds like the exact nightmare a previous employer was living. AWS' (awful) web UI convinces the faint of heart to click through wizards for everything. If you're not using version control for _anything_ related to your infrastructure...you have my thoughts and prayers. +1 for "click-ops", perfectly put.
- frompdx 6y ago> you have my thoughts and prayers. Pretty much. The lesson learned for me was to always have version control for the complete stack including the infra for the stack. I like terraform for this. Terragrunt at least solves the issue of modules for terraform reducing the verbosity. Assume things could go wrong and you will need to redeploy EVERYTHING. I've been there.
- bsder 6y ago> Acquiring company realizes mistake after the fact. Asks employee to turn over account. Employee declines. Acquiring company bites the bullet and shells out a five figure sum to employee to "buy" his account. Could have been avoided with some form of config management. That is completely the wrong lesson from this anecdote. 1) The acquiring company didn't do proper due diligence. Sorry, this is diligence 101--where are the accounts and who has the keys? 2) Click-Ops is FINE. In a startup, you do what you need now and the future can go to hell because the company may be bankrupt tomorrow. You fix your infra when you need to in a startup. 3) Long-time employee seemed to have exactly the right amount of paranoia regarding his bosses. The fact that the buyout appears to have killed his job and paid so little that he was willing to torch his reputation and risk legal action for merely five figures says something.
- tly_alex 6y agoMake sense. This is a classic example of bad operation management leads to unexpected outcome. Could have be solved much easier with proper configuration management.
- lonelappde 6y agoWhy not just migrate the resources? Spin up new instances, load data from snapshots, get back to work.
- tcgv 6y agoProbably because paying 5 figures to the account owner was cheaper, faster and safer than recreating the production env from scratch
- tly_alex 6y agoMigration on resources taking live traffic is not an easy thing. Before migrating the traffic over to a different end-point, the time and the engineering work to make sure the new endpoints works is money and cost. Also there could be statefull data in the original account and to do a live migration of data with new data coming in at X tps is absolutely hard work.
- valuearb 6y agoOnly 5 figures? That’s only what, a 100 hours of consulting? Sounds like the tiniest acquisition mistake I’ve ever heard of.