4 ms·
On my ops team, we've gotten some flak for not building robust enough of a request queue for some tasks. But it's been down several hours in the past year. The
by mancerayder 9y ago
On my ops team, we've gotten some flak for not building robust enough of a request queue for some tasks. But it's been down several hours in the past year. The server almost never needs maintenance. None of the workload is real-time. App restarts are acceptable if memory leaks occur.
If we did everything by the enterprise book, we'd still be 70% of the way to a deployed product, instead of 15 months into its completion.
Sure. Except if this Ops team is like most Ops teams, they'd prefer to do it the (cue dark, brooding orchestral dum-dum-dum musical interlude) 'enterprise' way rather than be woken up by PagerDuty in the middle of the night because a new release push lead to the CPU spiking.
Sorry, but I've almost never seen situations where people have skimped on HA and someone else didn't get excoriated during an outage.
Maybe other people's experiences are different, but as a DevOps guy, even in a relatively new environment, my priority is stability. Not faith-based-computing based on someone's positive seat-of-their-pants past experience.
- toomuchtodo 9y agoDevOps guy here! Completely agree. Reliable infrastructure at the cost of velocity isn't just good practice, it's self-preservation if you're ops.
- mancerayder 9y agoYeah. I think that's a huge part of the reason why the so-called 'full stack developers' will probably never obviate pure 'DevOps' roles. A lot of people can't wrap their heads around why setting up infrastructure takes so much time, and focus attention on speed of raw product (code) delivery.
- unethical_ban 9y agoAh, see, we're talking about different things. Our little request queue, though prod-necessary, only needs 98-99% uptime. Same with much of our automation. Once you ask the simple question "Does this cause an interruption to our core business, or to security?" and you can say "no", HA requirements go down, down, down.
- mancerayder 9y agoYeah, we're both arguing against extreme positions. I fully agree that so long as SLA's are negotiated proportionally to infrastructure investment in money and time, then it's all good. I've personally seen Ops teams get tricked by being told things weren't important, when in fact they became production emergencies with yelling when they invariably went down.