5 ms·

Something’s wonky, because it’s not just Cloudflare. One of my personal sites is down that uses nothing but a VPS, and I noticed my Unifi AP disconnect from its

by jchw 6y ago

Something’s wonky, because it’s not just Cloudflare. One of my personal sites is down that uses nothing but a VPS, and I noticed my Unifi AP disconnect from its controller a little bit ago. Fiber cut? Routing issues?

parliament32 6y ago
If that VPS is on DO they're down too cause of CF. Or if you set the resolver on your VPS to 1.1.1.1 that's also down.
- jchw 6y ago
  Why are digital ocean VPSes down due to a Cloudflare outage? Hoping for a clarifying post mortem...
  - unilynx 6y ago
    digitaloceans VPSes weren't down, but there do seem to be routing issues as TransIP can't reach DigitalOcean AMS3 (but it's all coming back now) Maybe the problem was somewhere on the AMS-IX
  - drchiu 6y ago
    My Digital Ocean load balancer went down. I think there's probably some internal routing? Would be interested to understand more.
- dpcx 6y ago
  DO is still up as my machines are still up and accessible.
rconti 6y ago
Huh. My Ubiquiti was reporting WAN link down during this outage. I'm using ATT fiber. I'm wondering if "link down" doesn't mean what I think it means. Now that I check, it says "WAN iface [eth2] transition to state [inactive]". I'm wondering if that means link down or if it's doing service checking. I actually have a WAN2 configured but not plugged in and it was set to "Load Balancing: Failover Only" ... I wonder if all of my 'connection issues' were software assuming my network link is down and switching interfaces to an unavailable one.
- rconti 6y ago
  to reply to myself, if you have a second interface configured for failover, it actually tests against ping.ubnt.com. I bet every single time my ATT fiber has "gone out" for a minute or two at a time, it's been bogus. root@USG-PRO-4:~# show load-balance watchdog Group wan_failover eth2 status: Running pings: 2 fails: 0 run fails: 0/3 route drops: 0 ping gateway: ping.ubnt.com - REACHABLE eth3 status: Waiting on recovery (0/3) failover-only mode pings: 1 fails: 1 run fails: 3/3 route drops: 1 ping gateway: ping.ubnt.com - DOWN last route drop : Fri Jul 17 17:32:58 2020

by jchw 6y ago

parliament32 6y ago

If that VPS is on DO they're down too cause of CF. Or if you set the resolver on your VPS to 1.1.1.1 that's also down.

jchw 6y ago
Why are digital ocean VPSes down due to a Cloudflare outage? Hoping for a clarifying post mortem...
- unilynx 6y ago
  digitaloceans VPSes weren't down, but there do seem to be routing issues as TransIP can't reach DigitalOcean AMS3 (but it's all coming back now) Maybe the problem was somewhere on the AMS-IX
- drchiu 6y ago
  My Digital Ocean load balancer went down. I think there's probably some internal routing? Would be interested to understand more.
dpcx 6y ago
DO is still up as my machines are still up and accessible.

rconti 6y ago

Huh. My Ubiquiti was reporting WAN link down during this outage. I'm using ATT fiber. I'm wondering if "link down" doesn't mean what I think it means. Now that I check, it says "WAN iface [eth2] transition to state [inactive]". I'm wondering if that means link down or if it's doing service checking. I actually have a WAN2 configured but not plugged in and it was set to "Load Balancing: Failover Only" ... I wonder if all of my 'connection issues' were software assuming my network link is down and switching interfaces to an unavailable one.

rconti 6y ago
to reply to myself, if you have a second interface configured for failover, it actually tests against ping.ubnt.com. I bet every single time my ATT fiber has "gone out" for a minute or two at a time, it's been bogus. root@USG-PRO-4:~# show load-balance watchdog Group wan_failover eth2 status: Running pings: 2 fails: 0 run fails: 0/3 route drops: 0 ping gateway: ping.ubnt.com - REACHABLE eth3 status: Waiting on recovery (0/3) failover-only mode pings: 1 fails: 1 run fails: 3/3 route drops: 1 ping gateway: ping.ubnt.com - DOWN last route drop : Fri Jul 17 17:32:58 2020