4 ms·
I can speak first hand about this. You want to know what the real problem is? Cheap motherfucking executives and boards. Full stop. I was at one time a one man
by arca_vorago 9y ago
I can speak first hand about this. You want to know what the real problem is? Cheap motherfucking executives and boards. Full stop. I was at one time a one man miracle show for a company that had 6 branch locations, and was supporting at any given time ~50 operational PLC's in the field, among other PLC's internally for other operations...
Now, I've learned a lot about mistakes I've made, and I was never a perfect senior sysadmin, mostly because I wasn't playing the meeting room presentations/reports and politics game. So I'm not trying to make myself out to be perfect in any fashion.
That said, when I requested a full time t2 person. Denied. Requested a full time t1 person. Denied. I literally had to poach some part timer who was sweeping floors and train them myself... which did nothing to alleviate my time crunch dealing with desktop users in order to tackle the substantial infrastructure security issues, which takes time and thought (did I mention it was an open office area, so good luck getting good thinking work done...) Requested contractor structured cabling job (just horizontal)... denied...
Us sysadmins can secure this stuff, mostly through really good network policies and firewalls, etc, but if management is cost-cutting corners left and right and would rather hire some contractor-MSP type that does 1/4 the work at x3 the cost, while refusing to support internal IT teams with the tools and funding they need to get their job done properly, it's no fucking wonder insecure systems abound in the industrial world.
This is managements problem, and until the public or others start punishing them for not seeing IT and security as an investment instead of just a janitorial cost-sink, it will continue to happen.
That's the reason behind my last burnout. Now I'm happily on break pursuing my data science degree. I've been on the contractor side too, (dropped out of college after the Marine Corps to start an IT support company that is still alive today even after I left) so I've seen the inside of hundreds of companies, from fortune 500 oil to 20 man lawfirms, so I'm not just pulling this info from a couple of jobs. I saw it everywhere.
A good CIO or CTO should be able to address many of the technical-political disconnects, but they hardly exist. Go try asking /r/sysadmin how many of them even get a real budget. Half the time they just have to "ask" and hope they were convincing enough that management approves. Usually to a CFO or CEO since the CTO/CIO doesn't exist.
Oh, and of course they all want to immediately jump on the IoT bandwagon but still don't want to hire the people to get them out of their old technical debt, much less the new massive technical debt many IoT devices will bring!
Don't even get me started on the "big data" issues IoT and many PLC type devices bring.
edit: The key to the increase of this issue is the direct LTE connections on the PLC's, whereas you used to have a satcon to a router and everything was internal from there, that's less true these days. Even so, you still have issues with the security of that edge.
- oceanghost 9y agoThis is every (bad) company ever. I worked for a company with 500m in revenue, that made nothing but consumer electronics, and defined its own ENGINEERS as "cost centers." You know the only people who weren't defined as cost centers by management? Themselves.
- junkcollector 9y agoTo touch on this a bit. To be a good controls guy that does PLC programming you need to have some mechanical background to understand the equipment you are controlling, you need to know enough electrical to do the wiring and parse what your sensors are telling you and you need to be a fair shake at programming/comm protocols/logic. Oh, and most control loop implementations are actually sets of differential equations with DSP inputs so having a knowledge in that stuff helps a lot when you get into the precision stuff. If you go look at the current postings for these roles you'll find that the average salary is between $15-$25/hr, you'll be on call 24/7, and you have to work physically demanding jobs in relatively harsh environments. I've seen a few outfits that don't even offer to pay their employees for commuting time between sites, only for when they are actually sitting down and working on the boards.