3 ms·
Dangerous curiosity ask, is whether the number of folks off for Diwali is a factor or not? I.e. lots of folks that weren't expected to work today and/or trying
by whaleofatw2022 1y ago
Dangerous curiosity ask, is whether the number of folks off for Diwali is a factor or not?
I.e. lots of folks that weren't expected to work today and/or trying to round them up to work the problem.
- junon 1y agoSeeing as how this is us-east-1, probably not a lot.
- redeux 1y agoI believe the implication is that a lot of critical AWS engineers are of Indian descent and are off celebrating today.
- herewulf 1y agojunon's implication may be that AWS engineers of Indian descent would tend to be located on the West Coast.
- jmedefind 1y agoNorth Virginia has a very large Indian community. All the schools in the area have days off for Indian Holidays since so many would be out of school otherwise.
- hinkley 1y agoThis broke in the middle of the day IST did it not? Why would you start waking up people in VA if it’s 3 in the morning there if you don’t have to?
- AutoDunkGPT 1y agoI bet you haven't gotten an email back from AWS support during twilight hours before. There are 153k Amazon employees based in India according to LinkedIn.
- junon 1y agoMissing my point entirely.
- hinkley 1y agoThen I missed it too because I let my Indian coworkers handle production issues after 9,10pm unless the problem sounds an awful lot like the feature toggle I flipped on in production is setting servers on fire. My main beef with that team was that we worked on too many stories in parallel so information on brand new work was siloed. Everyone caught up after a bit but stuff we just or hadn’t demoed yet was spotty for coverage. If I was up at 1 am it was because I had insomnia and figured out exactly what the problem was and it was faster to fix it than to explain. Or if I wake up really early and the problem is still not fixed.
- loudmax 1y agoNorthern Virginia's Fairfax County public schools have the day off for Diwali, so that's not an unreasonable question. In my experience, the teams at AWS are pretty diverse, reflecting the diversity in the area. Even if a lot of the Indian employees are taking the day off, there should be plenty of other employees to back them up. A culturally diverse employee base should mitigate against this sort of problem. If it does turn out that the outage was prolonged due to one or two key engineers being unreachable for the holiday, that's an indictment of AWS for allowing these single points of failure to occur, not for hiring Indians.
- dd_xplore 1y agoIt's more worse if caused by American engineers , not on holiday
- hinkley 1y agoSeems like a lot of people missing that this post was made around midnight PST time and thus it would be more reasonable to ping people at lunch in IST before waking up people in EST or PST.
- hinkley 1y agoMore info is claiming the problem started around 9:15 the previous day, but brewed for a while. But that’s still after breakfast in IST.
- hinkley 1y agoSometimes I miss my phone buzzing when doing yard work. Diwali has to be worse for that.