4 ms·

Fix is rolling out.

by jgrahamc 4y ago

Fix is rolling out.

stingraycharles 4y ago
(Parent is CTO of CloudFlare for those unaware)
- outworlder 4y ago
  I wish my CTO even knew what HN was.
  - lillecarl 4y ago
    Some would be happy if their CTO knew anything about computing!
- qwertox 4y ago
  Nice. In that case I'll try to get an update on Pingora's release date. Haven't heard anything about it lately :(
ehPReth 4y ago
Thank you! What happened out of curiosity?
- outworlder 4y ago
  Doubtful anyone would post anything here before there's time to write a proper RCA.
- jgrahamc 4y ago
  Team is writing it up. Will get it out later today.
  - tikotzky 4y ago
    We were seeing some pages with cookies incorrectly getting cached, causing users to get logged in as other users. We quickly disabled cache on the dashboard, is this related to that?
    - bcjordan 4y ago
      Curious what you find happened with that. On the webdev side—what can be done as extra defense-in-depth step to guard against this kind of issue? Unrelated to Cloudflare I feel like it is a common issue that crops up on even massive sites quite often. Is there some sort of secondary check / content decryption that could be required on the client-side to contain session cookie crossover?
      - rob-olmos 4y ago
        Outside of HTTPS, typically it would be tying the session cookie to the IP address or netblock but because it's Cloudflare IPs, for regular browser navigation requests I don't think there's anything that can be done?
    - jgrahamc 4y ago
      Please email me details (jgc).
  - ehPReth 4y ago
    Awesome - thanks :)
geocrasher 4y ago
Many thanks sir, from a company that uses Cloudflare Enterprise for delivery.
throwthere 4y ago
Is this related to switching the firmware on the Minitel 2?
- jgrahamc 4y ago
  I knew I shouldn't have done that: https://blog.jgc.org/2022/10/adding-mode-switch-to-my-minitel-2.html https://blog.jgc.org/2022/10/adding-mode-switch-to-my-minite...
  - stavros 4y ago
    I'd like to read an article about how the firmware caused the outage. It wouldn't be true, but it'd be a fun read.
    - jgrahamc 4y ago
      10 years ago we bought every Minitel in existence from eBay and connected them into a giant X.25 network spanning the globe. Unfortunately, one EPROM didn't have a cover over its window and bright sunlight in Madrid caused firmware corruption.
      - ThePowerOfFuet 4y ago
        > 10 years ago we bought every Minitel in existence from eBay and connected them into a giant X.25 network spanning the globe. Unfortunately, one EPROM didn't have a cover over its window and bright sunlight in Madrid caused firmware corruption. What a tease. If only.

Fix is rolling out.

stingraycharles 4y ago

(Parent is CTO of CloudFlare for those unaware)

outworlder 4y ago
I wish my CTO even knew what HN was.
- lillecarl 4y ago
  Some would be happy if their CTO knew anything about computing!
qwertox 4y ago
Nice. In that case I'll try to get an update on Pingora's release date. Haven't heard anything about it lately :(

ehPReth 4y ago

Thank you! What happened out of curiosity?

outworlder 4y ago
Doubtful anyone would post anything here before there's time to write a proper RCA.
jgrahamc 4y ago
Team is writing it up. Will get it out later today.
- tikotzky 4y ago
  We were seeing some pages with cookies incorrectly getting cached, causing users to get logged in as other users. We quickly disabled cache on the dashboard, is this related to that?
  - bcjordan 4y ago
    Curious what you find happened with that. On the webdev side—what can be done as extra defense-in-depth step to guard against this kind of issue? Unrelated to Cloudflare I feel like it is a common issue that crops up on even massive sites quite often. Is there some sort of secondary check / content decryption that could be required on the client-side to contain session cookie crossover?
    - rob-olmos 4y ago
      Outside of HTTPS, typically it would be tying the session cookie to the IP address or netblock but because it's Cloudflare IPs, for regular browser navigation requests I don't think there's anything that can be done?
  - jgrahamc 4y ago
    Please email me details (jgc).
- ehPReth 4y ago
  Awesome - thanks :)

geocrasher 4y ago

Many thanks sir, from a company that uses Cloudflare Enterprise for delivery.

throwthere 4y ago

Is this related to switching the firmware on the Minitel 2?

jgrahamc 4y ago
I knew I shouldn't have done that: https://blog.jgc.org/2022/10/adding-mode-switch-to-my-minitel-2.html https://blog.jgc.org/2022/10/adding-mode-switch-to-my-minite...
- stavros 4y ago
  I'd like to read an article about how the firmware caused the outage. It wouldn't be true, but it'd be a fun read.
  - jgrahamc 4y ago
    10 years ago we bought every Minitel in existence from eBay and connected them into a giant X.25 network spanning the globe. Unfortunately, one EPROM didn't have a cover over its window and bright sunlight in Madrid caused firmware corruption.
    - ThePowerOfFuet 4y ago
      > 10 years ago we bought every Minitel in existence from eBay and connected them into a giant X.25 network spanning the globe. Unfortunately, one EPROM didn't have a cover over its window and bright sunlight in Madrid caused firmware corruption. What a tease. If only.