4 ms·

I solved this same problem for a company also in 2019 (as the CPU quota bug hadn't been fixed yet) and it resulted in something like 8 figures of yearly cost sa

I solved this same problem for a company also in 2019 (as the CPU quota bug hadn't been fixed yet) and it resulted in something like 8 figures of yearly cost savings. You are correct in that most companies are not equipped to staff issues like this. Most places just accept their bills as a cost of doing business, not something that can be optimized.

deleted 5y ago
[deleted]
eloff 5y ago
This. I've never worked anywhere that had dedicated ongoing effort to cost reduction in compute services. It's always a once every couple of years thing to look at the cloud spending and spend a little effort dealing with the low hanging fruit.
_jal 5y ago
A side effect of deciding systems engineers can be replaced by devops. In reality, you want both. A good systems person can save you a ton of money.
- ithkuil 5y ago
  A nice approach is to staff a DevOps team with people from diverse backgrounds; some more towards the system side of the spectrum and some more towards the dev side of the spectrum. As long as everybody knows a little bit of the other side. This helps ok avoiding a culture where devs "throw some code over the fence" and sysops people just moan that devs are careless and/or that they should do things differently, but without a clear way of showing exactly how differently things should be made (and also without a clear understanding of what devs ended up choosing the way they choose)
  - bradknowles 5y ago
    Who does DevOps teams anymore? Don’t you know that all devs should also be ops, and you can cut your staff in half? Seriously, some employers I’ve know seem to take exactly that approach. Just fire all the ops guys, and tell the devs that they’re now going to be doing DevOps.
    - ithkuil 5y ago
      Oops I clearly didn't mean a dedicated DevOps team; I mean a team that develops and runs a product, what DevOps originally meant (and not the glorified developer tools team that often people have nowadays with that name)
      - waynesonfire 5y ago
        Devops developed and ran product? Never heard of that. What disconnected manifesto did you read?
        ithkuil 5y ago
        Is the word product rather than service that bothers you or the fact that DevOps develop and operate?
karmakaze 5y ago
I can see how there are diminishing returns when optimizing but I would never say that server bills are not a metric to be aware of and address. I've always had some idea of what's practically achievable in terms of efficiency within a given architecture and aim for something that gets a good amount of the way there without undue effort. I also enjoy thinking of longer term improvements for efficiency whether that could improve latency or the bottom line and at the same time know that's secondary to providing additional value and gaining customers during a growth period.

deleted 5y ago

[deleted]

eloff 5y ago

This. I've never worked anywhere that had dedicated ongoing effort to cost reduction in compute services. It's always a once every couple of years thing to look at the cloud spending and spend a little effort dealing with the low hanging fruit.

_jal 5y ago

A side effect of deciding systems engineers can be replaced by devops. In reality, you want both. A good systems person can save you a ton of money.

ithkuil 5y ago
A nice approach is to staff a DevOps team with people from diverse backgrounds; some more towards the system side of the spectrum and some more towards the dev side of the spectrum. As long as everybody knows a little bit of the other side. This helps ok avoiding a culture where devs "throw some code over the fence" and sysops people just moan that devs are careless and/or that they should do things differently, but without a clear way of showing exactly how differently things should be made (and also without a clear understanding of what devs ended up choosing the way they choose)
- bradknowles 5y ago
  Who does DevOps teams anymore? Don’t you know that all devs should also be ops, and you can cut your staff in half? Seriously, some employers I’ve know seem to take exactly that approach. Just fire all the ops guys, and tell the devs that they’re now going to be doing DevOps.
  - ithkuil 5y ago
    Oops I clearly didn't mean a dedicated DevOps team; I mean a team that develops and runs a product, what DevOps originally meant (and not the glorified developer tools team that often people have nowadays with that name)
    - waynesonfire 5y ago
      Devops developed and ran product? Never heard of that. What disconnected manifesto did you read?
      - ithkuil 5y ago
        Is the word product rather than service that bothers you or the fact that DevOps develop and operate?

karmakaze 5y ago

I can see how there are diminishing returns when optimizing but I would never say that server bills are not a metric to be aware of and address. I've always had some idea of what's practically achievable in terms of efficiency within a given architecture and aim for something that gets a good amount of the way there without undue effort. I also enjoy thinking of longer term improvements for efficiency whether that could improve latency or the bottom line and at the same time know that's secondary to providing additional value and gaining customers during a growth period.