4 ms·
It didn't just crash, it crashed 100% of computers running it at that time and in a way that required physical intervention to fix. So I think you can considers
by fabian2k 2y ago
It didn't just crash, it crashed 100% of computers running it at that time and in a way that required physical intervention to fix. So I think you can considers this quite different from regular crashes because recovery is much more difficult and because it affected a lot of computers simultaneously.
On top of that there are companies that had failures of their own in their recovery procedures. But even with good procedures this can be a significant outage because it is not trivially reverted and would typically affect many configurations that are redundant for many other failures.
- Retr0id 2y agoIf the uptime of 100% of your computers depends on a single vendor not writing software with bugs in it, you have a problem.
- fabian2k 2y agoThat would mean that you always need a fully redundant copy of everything based on entirely different OSes and software with no common component. That is obviously not realistic.
- Retr0id 2y agoBuilding high-assurance systems is expensive. Anyone not doing so must accept the associated risks (which is fine, not everything needs to be high-assurance).
- withinboredom 2y agoNo. You just need to not update them all at the same time.
- simiones 2y agoUnfortunately, CrowdStrike decides when it's time to upgrade CrowdStrike software, not the admins.
- prmoustache 2y ago1. Your IT department shouldn't buy a product that let a third party change files on your system remotely. This one is the basis of computer security. 2. Your IT department shouldn't buy a product that doesn't give you control on when updates are applied. These are 2 huge security failures from your IT department.
- simiones 2y agoAutomatic security updates are widely touted as the gold standard in IT security, at least for anything that is not a life-support system.
- prmoustache 2y agoI am talking about control, I am not talking about disabling automatisation of updates. You can have automatic security updates with delay between non prod and prod environments so that you can detect failures or possibly intrusions.
- adunsulag 2y agoMy understanding is that customers believed they had control as Crowdstrike gave them configuration options to delay updates / stagger them. Apparently many of them were surprised that Crowdstrike had the ability to bypass all these configuration options and force the update. I think that is where Crowdstrike's liability skyrockets through the roof.
- simiones 2y agoWhat if the uptime of 50% of your computers does, but you need 100% percent of your computers to run at 100% capacity? If a shop has two lathes and one crashes, and now the shop has 50% capacity, is not losing money because of CrowdStrike's incompetence?