8 ms·
They probably scaled down their infrastructure over the holidays, but now that everyone is back at work they're underprovisioned.
by danielsamuels 6y ago
They probably scaled down their infrastructure over the holidays, but now that everyone is back at work they're underprovisioned.
- ApolloFortyNine 6y agoWas my first though too, really looks like they scale down based on the average of the last 2 weeks, but obviously this last 2 weeks would have been extremely low.
- traviscj 6y agoahhh this is a much better theory than mine: my first thought was the lifting of a holiday deploy freeze.
- ellisv 6y agoOh man I didn't even think of that one
- ellisv 6y agoI hope that's the issue.
- derwiki 6y agoHmm so 2021 is the year they switch to k8s for fast scale up and multiple engineers get a promo out of it?
- dangoldin 6y agoYou'd think at their size of their team they'd understand that they would need to scale back up in anticipation of the post holiday return to work. Slack has the most outages of any major company.
- escardin 6y agoMy thought was everyones local cache was expired and it's re-syncing everyone. Supposedly they run vitess for mysql sharding, and that could mean they're getting slammed by a lot of scatter or cross shard queries they can normally handle.