5 ms·

Wonder if some of their critical infra got hit by a power outage?[0] Really a power outage shouldn't cause this as backups and generators...but maybe something

by flutas 4y ago

Wonder if some of their critical infra got hit by a power outage?[0] Really a power outage shouldn't cause this as backups and generators...but maybe something was overlooked? Guess we will just have to wait and see what the postmortem says. [0]: Context: https://poweroutage.us/ https://poweroutage.us/ EDIT: Seems like a no based on the latest update. > Identified - We've identified an internal systems issue and are working to determine a fix.

alfalfasprout 4y ago
Is reddit on-prem or in the cloud? If in the cloud, AWS/GCE have tons of redundancy in power, internet connectivity, etc.
- a2tech 4y ago
  If I recall correctly they're in the cloud
  - paradox460 4y ago
    They moved to AWS early early. There used to be an old picture of someone (iirc Alexis) joking about shutting down the data center they were in, and hosing Twitter in the process. Would have been 2008-9 era
- solarmist 4y ago
  Except AWS is experiencing issues now. https://news.ycombinator.com/item?id=35157388 https://news.ycombinator.com/item?id=35157388
takeda 4y ago
Way to push your biases. The most affected part of California is central: https://poweroutage.us/area/state/california https://poweroutage.us/area/state/california It's because they currently have floods there. Reddit runs on AWS and they don't have region in central CA so it's obvious whatever they are experiencing is unrelated.
- flutas 4y ago
  > The most affected part of California is central: > Reddit runs on AWS and they don't have region in central CA so it's obvious whatever they are experiencing is unrelated. Reddit also uses fastly for their CDN. Considering the error message for the vast majority of this was (still is) "Our CDN was unable to reach our servers" it made me look at the CDN connection... which has multiple DCs in San Jose... You know, the "most affected part of California." > Way to push your biases. Nah, no bias. Just following the sites goal. > On-Topic: (...) If you had to reduce it to a sentence, the answer might be: anything that gratifies one's intellectual curiosity. Hence why I said "Wonder if" not "they must have."

by flutas 4y ago

alfalfasprout 4y ago

Is reddit on-prem or in the cloud? If in the cloud, AWS/GCE have tons of redundancy in power, internet connectivity, etc.

a2tech 4y ago
If I recall correctly they're in the cloud
- paradox460 4y ago
  They moved to AWS early early. There used to be an old picture of someone (iirc Alexis) joking about shutting down the data center they were in, and hosing Twitter in the process. Would have been 2008-9 era
solarmist 4y ago
Except AWS is experiencing issues now. https://news.ycombinator.com/item?id=35157388 https://news.ycombinator.com/item?id=35157388

takeda 4y ago

Way to push your biases. The most affected part of California is central: https://poweroutage.us/area/state/california https://poweroutage.us/area/state/california It's because they currently have floods there. Reddit runs on AWS and they don't have region in central CA so it's obvious whatever they are experiencing is unrelated.

flutas 4y ago
> The most affected part of California is central: > Reddit runs on AWS and they don't have region in central CA so it's obvious whatever they are experiencing is unrelated. Reddit also uses fastly for their CDN. Considering the error message for the vast majority of this was (still is) "Our CDN was unable to reach our servers" it made me look at the CDN connection... which has multiple DCs in San Jose... You know, the "most affected part of California." > Way to push your biases. Nah, no bias. Just following the sites goal. > On-Topic: (...) If you had to reduce it to a sentence, the answer might be: anything that gratifies one's intellectual curiosity. Hence why I said "Wonder if" not "they must have."