4 ms·

Cloudflare Connectivity Issues in Eastern US and Central Europe

71 points by dgellow 2y ago

dgellow 2y ago
I'm in Northern Germany, HN and Github are the only sites working for me at the moment. All websites behind cloudflare return a 502 :(
- jumploops 2y ago
  Sounds like I can go about my day normally then!
- dartos 2y ago
  Gotta love centralization
  - bloopernova 2y ago
    Blame the assholes who DDOS and the hardware/software vendors who enable them by selling insecure computing devices.
  - JohnMakin 2y ago
    If you are able to build a competing product that can offer what cloudflare does at the scale that it does I promise there is billions of dollars in it for you.
    - dartos 2y ago
      Just because it’s hard to make a competitor doesn’t mean that it’s good that there isn’t one.
      - JohnMakin 2y ago
        I'm really unsure what you are trying to say. Is there someone doing what cloudflare is doing now? I do not think so. Until that day, this will be how it is. It's very silly to complain about "centralization" when there is really not an alternative to what cloudflare provides.
- aniviacat 2y ago
  Also Northern Germany, but for me everything (including my Cloudflare Pages site) still works. Odd.
jebby 2y ago
I had to change my DNS from Cloudflare to Google last night somewhere around midnight Eastern because everything but telegram stopped working, presuming that Telegram must use an IP or something for its endpoints. Wonder if it's related?
madjam002 2y ago
My Cloudflare Pages site has gone down completely, anyone else?
- austinpena 2y ago
  Mine are fine.
- snorremd 2y ago
  Mine are offline as well (502 Bad Gateway). I'm in one of the affected regions, Europe West.
  - moffkalast 2y ago
    Ah yes, Cloudflare throwing half the internet offline for hours with one bad config. It's even funnier the 5th, er 6th time? Maybe 7th?
    - snorremd 2y ago
      Hey now. I'm sure Cloudflare can deliver 502 Bad Gateway pages with less latency than any other cloud provider. ;)
  - madjam002 2y ago
    Yep I get the 502 Bad Gateway and sometimes the standard Cloudflare error page. I love how the Cloudflare error page says "Cloudflare is working" and it's my website causing the problem.. even though it's Cloudflare pages haha
- NicoJuicy 2y ago
  Mine is ok, west-Europe
iSloth 2y ago
From the UK my requests appear to be hitting Cloudflare in Singapore. They've got planned changes in Sydney/Toyko ongoing, so could be fat finger moment with routing.
milankragujevic 2y ago
I noticed my website has been timing out randomly, and checking Apache server-status page I don't see the requests that are in flight. At first when I noticed timeouts and slow response, I assumed it was due to my connection or my server. However, after checking on apache, it seems some requests aren't going through at all. I checked the CF status page at the time, there wasn't this notice, but now there is. I hope this gets resolved soon.
bjw4 2y ago
Seems to affected Apple Private Relay as well, really slow download (kb/s) and timeouts
wpnx 2y ago
West coast is affected as well
sandGorgon 2y ago
github in india is affected.
- helloericsf 2y ago
  I don't think github is using cloudflare.
  - tracker1 2y ago
    I think Github pages (published sites) are using Cloudflare. edit: My mistake, I seem to have misremembered an article on using GH Pages with Cloudflare (circa 2016).
    - jsheard 2y ago
      Nope, Github Pages runs on Fastly. You can see it in the HTTP headers.
inglor_cz 2y ago
My website (kechlibar.net) is experiencing the problem as well.
- tebbers 2y ago
  Seems to load fine for me from London at least.
  - inglor_cz 2y ago
    It seems to be intermittent. I was able to access my site through a VPN, then not for 10 minutes, then sometimes yes, sometimes no.
hobbescotch 2y ago
Having lots of random issues with gcp today as well
dtquad 2y ago
Why is this level of centralization accepted? Many European governments have also started using Cloudflare after suffering DDoS attacks following the 2022 Russian invasion of Ukraine and European sanctions on Russia.
- xd1936 2y ago
  Kind of sounds like you answered your own question there.
  - dmix 2y ago
    Because there's DDOS attacks everyone should use the same platform and give them control of the internet?
    - rossdavidh 2y ago
      No, because it's complicated to run, and difficult to the point of impossible for a normal small amount of servers to withstand a DDOS. Why do we get our electricity from the power company, even though there are occasionally outages? We could just all get generators and battery-backed solar, but that would be expensive and hard to maintain. The scale of AWS, Cloudflare, Akamai, etc. make them less bad at it that the average company that needs a website. It's the same reason we don't all have our own mailservers.
    - deleted 2y ago
      [deleted]
    - jsheard 2y ago
      It would be nice to have a choice, but most of their competition is either priced completely out of the reach of most people, or PAYG with unbounded spending so you can get hit with an enormous bill out of nowhere, which you don't have to worry about with Cloudflare. AWS or Azure or Google could make their pricing structures as approachable as CFs if they wanted to, and peel off many of CFs small-to-medium scale customers, but evidently none of them want to even try. They only care about scoring whales.
    - deleted 2y ago
NorwegianDude 2y ago
That's a lot of website that are now down... I find it impressive how terrible bigger services that are supposedly "redundant" are at reliability because of all the added complexity.
- tracker1 2y ago
  It happens... It's happened with S3, other AWS, Azure, GCP, and a number of other systems over the years. Seems to happen a couple times a year between them all. That said, on self-hosting I've had outages that were self-inflicted more often than with cloud pipelines and CI/CD flows to production... in the end, it's probably a wash or favors cloud all the same. Even if it's more generally felt from cloud providers all at once.
- lxgr 2y ago
  It’s just incentives: Only your site is down, for the first time this year? You must suck at reliability! Your site is down for the third time this year because of a Cloudflare or AWS outage, together with hundreds of others? Force majeure, can’t be helped.
indigodaddy 2y ago
darn, i wish this script had each location resolve it's own dns, that way could gain a glimpse of global external dns cloudflare querying issues if you mtr a name that uses CF... https://mtr.ping.pe/ https://mtr.ping.pe/
deleted 2y ago
[deleted]
miyuru 2y ago
In Asia there were lot of timeout errors and slowness during the past 7 days.
chaps 2y ago
Heh, right when this started, Windows 11 started freaking out and blacking out my screen every 3s or so. Had to reboot to fix it! Definitely possible it wasn't this outage, but....
flutas 2y ago
So this is why our JIRA won't load for me to pick up a ticket... lol

71 points by dgellow 2y ago

I'm in Northern Germany, HN and Github are the only sites working for me at the moment. All websites behind cloudflare return a 502 :(

jumploops 2y ago
Sounds like I can go about my day normally then!
dartos 2y ago
Gotta love centralization
- bloopernova 2y ago
  Blame the assholes who DDOS and the hardware/software vendors who enable them by selling insecure computing devices.
- JohnMakin 2y ago
  If you are able to build a competing product that can offer what cloudflare does at the scale that it does I promise there is billions of dollars in it for you.
  - dartos 2y ago
    Just because it’s hard to make a competitor doesn’t mean that it’s good that there isn’t one.
    - JohnMakin 2y ago
      I'm really unsure what you are trying to say. Is there someone doing what cloudflare is doing now? I do not think so. Until that day, this will be how it is. It's very silly to complain about "centralization" when there is really not an alternative to what cloudflare provides.
aniviacat 2y ago
Also Northern Germany, but for me everything (including my Cloudflare Pages site) still works. Odd.

jebby 2y ago

I had to change my DNS from Cloudflare to Google last night somewhere around midnight Eastern because everything but telegram stopped working, presuming that Telegram must use an IP or something for its endpoints. Wonder if it's related?

madjam002 2y ago

My Cloudflare Pages site has gone down completely, anyone else?

austinpena 2y ago
Mine are fine.
snorremd 2y ago
Mine are offline as well (502 Bad Gateway). I'm in one of the affected regions, Europe West.
- moffkalast 2y ago
  Ah yes, Cloudflare throwing half the internet offline for hours with one bad config. It's even funnier the 5th, er 6th time? Maybe 7th?
  - snorremd 2y ago
    Hey now. I'm sure Cloudflare can deliver 502 Bad Gateway pages with less latency than any other cloud provider. ;)
- madjam002 2y ago
  Yep I get the 502 Bad Gateway and sometimes the standard Cloudflare error page. I love how the Cloudflare error page says "Cloudflare is working" and it's my website causing the problem.. even though it's Cloudflare pages haha
NicoJuicy 2y ago
Mine is ok, west-Europe

iSloth 2y ago

From the UK my requests appear to be hitting Cloudflare in Singapore. They've got planned changes in Sydney/Toyko ongoing, so could be fat finger moment with routing.

milankragujevic 2y ago

I noticed my website has been timing out randomly, and checking Apache server-status page I don't see the requests that are in flight. At first when I noticed timeouts and slow response, I assumed it was due to my connection or my server. However, after checking on apache, it seems some requests aren't going through at all. I checked the CF status page at the time, there wasn't this notice, but now there is. I hope this gets resolved soon.

bjw4 2y ago

Seems to affected Apple Private Relay as well, really slow download (kb/s) and timeouts

wpnx 2y ago

West coast is affected as well

sandGorgon 2y ago

github in india is affected.

helloericsf 2y ago
I don't think github is using cloudflare.
- tracker1 2y ago
  I think Github pages (published sites) are using Cloudflare. edit: My mistake, I seem to have misremembered an article on using GH Pages with Cloudflare (circa 2016).
  - jsheard 2y ago
    Nope, Github Pages runs on Fastly. You can see it in the HTTP headers.

inglor_cz 2y ago

My website (kechlibar.net) is experiencing the problem as well.

tebbers 2y ago
Seems to load fine for me from London at least.
- inglor_cz 2y ago
  It seems to be intermittent. I was able to access my site through a VPN, then not for 10 minutes, then sometimes yes, sometimes no.

hobbescotch 2y ago

Having lots of random issues with gcp today as well

dtquad 2y ago

Why is this level of centralization accepted? Many European governments have also started using Cloudflare after suffering DDoS attacks following the 2022 Russian invasion of Ukraine and European sanctions on Russia.

xd1936 2y ago
Kind of sounds like you answered your own question there.
- dmix 2y ago
  Because there's DDOS attacks everyone should use the same platform and give them control of the internet?
  - rossdavidh 2y ago
    No, because it's complicated to run, and difficult to the point of impossible for a normal small amount of servers to withstand a DDOS. Why do we get our electricity from the power company, even though there are occasionally outages? We could just all get generators and battery-backed solar, but that would be expensive and hard to maintain. The scale of AWS, Cloudflare, Akamai, etc. make them less bad at it that the average company that needs a website. It's the same reason we don't all have our own mailservers.
  - deleted 2y ago
    [deleted]
  - jsheard 2y ago
    It would be nice to have a choice, but most of their competition is either priced completely out of the reach of most people, or PAYG with unbounded spending so you can get hit with an enormous bill out of nowhere, which you don't have to worry about with Cloudflare. AWS or Azure or Google could make their pricing structures as approachable as CFs if they wanted to, and peel off many of CFs small-to-medium scale customers, but evidently none of them want to even try. They only care about scoring whales.
  - deleted 2y ago

NorwegianDude 2y ago

That's a lot of website that are now down... I find it impressive how terrible bigger services that are supposedly "redundant" are at reliability because of all the added complexity.

tracker1 2y ago
It happens... It's happened with S3, other AWS, Azure, GCP, and a number of other systems over the years. Seems to happen a couple times a year between them all. That said, on self-hosting I've had outages that were self-inflicted more often than with cloud pipelines and CI/CD flows to production... in the end, it's probably a wash or favors cloud all the same. Even if it's more generally felt from cloud providers all at once.
lxgr 2y ago
It’s just incentives: Only your site is down, for the first time this year? You must suck at reliability! Your site is down for the third time this year because of a Cloudflare or AWS outage, together with hundreds of others? Force majeure, can’t be helped.

indigodaddy 2y ago

darn, i wish this script had each location resolve it's own dns, that way could gain a glimpse of global external dns cloudflare querying issues if you mtr a name that uses CF... https://mtr.ping.pe/ https://mtr.ping.pe/

deleted 2y ago

[deleted]

miyuru 2y ago

In Asia there were lot of timeout errors and slowness during the past 7 days.

chaps 2y ago

Heh, right when this started, Windows 11 started freaking out and blacking out my screen every 3s or so. Had to reboot to fix it! Definitely possible it wasn't this outage, but....

flutas 2y ago

So this is why our JIRA won't load for me to pick up a ticket... lol