6 ms·
I'm kind of curious what the source of the outage is. It looks like most of their services are down, including their incident status page¹. The number of thing
by Jaepa 4y ago
I'm kind of curious what the source of the outage is.
It looks like most of their services are down, including their incident status page¹. The number of things I can think of that so many different services & are not a massively catastrophic failure is pretty small. Though that may be a lack of imagination on my part.
1: https://status.protontech.ch/incidents/195 https://status.protontech.ch/incidents/195
- IG_Semmelweiss 4y agoI'm seeing their status page up now. But they are down hard otherwise.
- jjtheblunt 4y agomaybe the status page is therefore also down, misleadingly showing its last pre-down state
- willis936 4y agoThey have another status page that currently reports everything is up (it isn't). https://status.proton.me/ https://status.proton.me/
- LeifCarrotson 4y agoAnd another that says that some systems (many systems) are experiencing issues/in a state of "partial outage": https://protonstatus.com/ https://protonstatus.com/
- KineticArms 4y ago"An error occurred on client"
- guerrilla 4y agoMaybe it's the same hard drive problem a lot of others (including HN) had.
- 0xbadcafebee 4y agoDoesn't have to be catastrophic failure. Most people just assume that such services are architected properly to be HA, but they usually aren't. They also aren't operated as HA usually, so things like a config change are rolled out globally to everything at once, and then everything breaks and they can't roll back, and you have total outage. Very common. ...and of course, they might not be down at all, it might just be (example) a route from the west coast got fucked in a BGP table so the west coast can't access it, and if that's where the majority of their users are that's all the comments you'll see.
- confounded 4y agoWhat is HA?
- sllabres 4y agoA bit nitpicking but even with a proper implemented HA solution there would be a service interruption.
- krn 4y ago> The number of things I can think of that so many different services & are not a massively catastrophic failure is pretty small. Like, for instance, a simple DNS or BGP misconfiguration that takes the entire network down? Cloudflare (June 2022): https://news.ycombinator.com/item?id=31823132 https://news.ycombinator.com/item?id=31823132 OVH (October 2021): https://news.ycombinator.com/item?id=28849319 https://news.ycombinator.com/item?id=28849319 Facebook (October 2021): https://news.ycombinator.com/item?id=28752131 https://news.ycombinator.com/item?id=28752131 Google (June 2019): https://news.ycombinator.com/item?id=20077421 https://news.ycombinator.com/item?id=20077421
- 29083011397778 4y agoWe don't know for certain, but you may have missed Rogers [0] - which brought down cell phones (every function but wifi), debit transactions, and 911 services. [0] https://en.m.wikipedia.org/wiki/2022_Rogers_Communications_outage https://en.m.wikipedia.org/wiki/2022_Rogers_Communications_o...
- tick_tock_tick 4y agoNo ones it too big to not fuck up BGP or DNS from time to time.
- 0xbadcafebee 4y agohttps://protonstatus.com/incidents/195#update-201 45 minutes ago : Our engineering team is working on a database performance issue which is impacting Proton services Relational database woes. :( Probably re-indexing or slow queries or something. This is why companies with an RDBMS as a SPOF need a good DBA.
- brewdad 4y agoMaybe they installed a whole lot of SSDs on the same day 4.5 years ago.