6 ms·

Cloudflare is experiencing elevated 5xx responses

appears to be down for many websites see https://www.cloudflarestatus.com/

Ocha 3y ago
Didn’t experience any outage for mailsnag.com. We have newrelic synthetic checks around the globe, and another uptime monitor. Not even a blip on the charts.
RyanGWU82 3y ago
I'm also seeing a lot of 1016/1018 "Origin DNS errors" across a variety of web services. I saw this on my own company's website first around 21:40 UTC, although it's not bad enough to materially affect our traffic volume.
ciceryadam 3y ago
It's fixed, at least for us. We had a bunch of 530 codes returned on our endpoints, although Cloudflare says that they implemented a fix at 22:39 UTC, we don't have an increased rate of errors since 22:10 UTC.
- LoganDark 3y ago
  Makes sense, they waited until the fix was fully deployed and working before saying that it had been implemented.
spindle 3y ago
I keep imagining an elevated 5xx response is a 599 when it should be a 503 or a 504.
- readyplayernull 3y ago
  Raised to the power.
- jonasenordin 3y ago
  If status codes bleed into 6xx we'll know HE COMES. I am starting an early warning system, a daemon process, polling random web sites for status lines like this. Do I need to handle Unicode?
tremon 3y ago
Ah, that might explain why I was seeing http 520 errors from various sites. It was the first time in a long time that I needed to lookup a http response code, only to find it's an unofficial one.
devaiops9001 3y ago
Are databases of Cloudflare's core services deployed in more than one AZ yet?
ChrisArchitect 3y ago
Tell HN:
sillysaurusx 3y ago
Apropos nothing, I found out today that bash.org died. https://news.ycombinator.com/item?id=37295238 https://news.ycombinator.com/item?id=37295238 was the last I was able to find about it, and it's the top google search result. I've been thinking of the best way to make a website that won't die when I die. It seems like a hard problem. I was originally going to just trust that Github Pages will be around forever, but I'm not so sure anymore. Running your own server is fraught with danger. In theory it's just a matter of making sure your account has enough credits to last 100 years. In practice, I can't count the number of times that servers have had one problem or another that requires manual intervention to resurrect. It's surprising that this isn't a solved problem. "Put some HTML somewhere" has always left the question of "where?" Maybe paying for your own S3 account and shoving the HTML onto that is the way to go. Still, thinking of the number of companies that have survived even 20 years, the odds aren't good that both S3 and Cloudflare will run flawlessly for decades. Oh yeah, the reason we're able to read these comments now is because Dan migrated HN away from Cloudflare, I think to Route 53. So maybe S3 + Route 53 has the highest odds of standing the test of time. Then there's the question of what to write. But at least "test website please ignore" has a chance of lasting a century, unlike everyone else.
- prox 3y ago
  Maybe the Long Now Foundation could start a 10k years hosting plan. That would be very interesting. Also being a sysadmin for a 10k server park would be a interesting job.
  - featuregag 3y ago
    > Also being a sysadmin for a 10k server park would be an interesting job. Ideally not frequently interesting, though.
    - DiggyJohnson 3y ago
      journalctl —follow -u long-now.service Just sit and watch.
- 3y ago
lemoncookiechip 3y ago
Discord is having issues right now, unsure if it's related. - Investigating - We are working to correct an issue that is causing some servers to be degraded and unavailable. - Update - We are continuing to investigate this issue.
- cloudking 3y ago
  +1 can't access any Discord servers
  - deleted 3y ago
    [deleted]

appears to be down for many websites see https://www.cloudflarestatus.com/

Ocha 3y ago

Didn’t experience any outage for mailsnag.com. We have newrelic synthetic checks around the globe, and another uptime monitor. Not even a blip on the charts.

RyanGWU82 3y ago

I'm also seeing a lot of 1016/1018 "Origin DNS errors" across a variety of web services. I saw this on my own company's website first around 21:40 UTC, although it's not bad enough to materially affect our traffic volume.

ciceryadam 3y ago

It's fixed, at least for us. We had a bunch of 530 codes returned on our endpoints, although Cloudflare says that they implemented a fix at 22:39 UTC, we don't have an increased rate of errors since 22:10 UTC.

LoganDark 3y ago
Makes sense, they waited until the fix was fully deployed and working before saying that it had been implemented.

spindle 3y ago

I keep imagining an elevated 5xx response is a 599 when it should be a 503 or a 504.

readyplayernull 3y ago
Raised to the power.
jonasenordin 3y ago
If status codes bleed into 6xx we'll know HE COMES. I am starting an early warning system, a daemon process, polling random web sites for status lines like this. Do I need to handle Unicode?

tremon 3y ago

Ah, that might explain why I was seeing http 520 errors from various sites. It was the first time in a long time that I needed to lookup a http response code, only to find it's an unofficial one.

devaiops9001 3y ago

Are databases of Cloudflare's core services deployed in more than one AZ yet?

ChrisArchitect 3y ago

Tell HN:

sillysaurusx 3y ago

Apropos nothing, I found out today that bash.org died. https://news.ycombinator.com/item?id=37295238 https://news.ycombinator.com/item?id=37295238 was the last I was able to find about it, and it's the top google search result. I've been thinking of the best way to make a website that won't die when I die. It seems like a hard problem. I was originally going to just trust that Github Pages will be around forever, but I'm not so sure anymore. Running your own server is fraught with danger. In theory it's just a matter of making sure your account has enough credits to last 100 years. In practice, I can't count the number of times that servers have had one problem or another that requires manual intervention to resurrect. It's surprising that this isn't a solved problem. "Put some HTML somewhere" has always left the question of "where?" Maybe paying for your own S3 account and shoving the HTML onto that is the way to go. Still, thinking of the number of companies that have survived even 20 years, the odds aren't good that both S3 and Cloudflare will run flawlessly for decades. Oh yeah, the reason we're able to read these comments now is because Dan migrated HN away from Cloudflare, I think to Route 53. So maybe S3 + Route 53 has the highest odds of standing the test of time. Then there's the question of what to write. But at least "test website please ignore" has a chance of lasting a century, unlike everyone else.

prox 3y ago
Maybe the Long Now Foundation could start a 10k years hosting plan. That would be very interesting. Also being a sysadmin for a 10k server park would be a interesting job.
- featuregag 3y ago
  > Also being a sysadmin for a 10k server park would be an interesting job. Ideally not frequently interesting, though.
  - DiggyJohnson 3y ago
    journalctl —follow -u long-now.service Just sit and watch.
3y ago

lemoncookiechip 3y ago

Discord is having issues right now, unsure if it's related. - Investigating - We are working to correct an issue that is causing some servers to be degraded and unavailable. - Update - We are continuing to investigate this issue.

cloudking 3y ago
+1 can't access any Discord servers
- deleted 3y ago
  [deleted]