11 ms·

Ask HN: Why were OpenAI, Claude, and Grok simultaneously down?

404 points by halcdev 29d ago

https://status.openai.com https://status.openai.com https://status.claude.com https://status.claude.com https://status.x.ai https://status.x.ai ChatGPT outage – Resolved - https://news.ycombinator.com/item?id=49550614 https://news.ycombinator.com/item?id=49550614 (315 comments) Claude outage – Resolved - https://news.ycombinator.com/item?id=49549676 https://news.ycombinator.com/item?id=49549676 (146 comments) Grok outage - https://news.ycombinator.com/item?id=49551589 https://news.ycombinator.com/item?id=49551589 (142 comments)

oytis 29d ago
Is it DNS or BGP?
- indigodaddy 29d ago
  I don't think you'd get a 404 if you weren't able to reach the endpoint because of DNS or networking? 404 is an active response from the server (or LB/proxy in front etc) no?
  - oytis 29d ago
    I imagine OpenAI network is a tad more complex than a box with a public IP.
    - indigodaddy 29d ago
      Concept is the same though. If one blurts DNS?, it's usually because the idea is you're not getting to an endpoint associated with the service. A 404 means there shouldn't be "DNS" (or networking) concerns (at the least those associated with the DNS cacher you are using or networking that you or your ISP controls)
moonman22 29d ago
Maybe Hugging Face got upset over being hacked and struck back. It's working fine while ChatGPT, Claude and Grok are all having major issues. Hmmm.....
ashesandrain01 29d ago
Darn, I was hoping for advice on how to get my MIL to leave my house haha
- CrewRiderz 29d ago
  LOL.
Iamharry 29d ago
Codex and chat is giving 404 errors in The Netherlands
authentictimers 29d ago
at least the Ollama cloud is still alive :D
dhruvrrp 29d ago
Both clause and codex through bedrock seem to be working fine.
apurva_w 29d ago
still down for me ..in India.
sirkamyab 29d ago
The webpage is actually working but the codex is down for me!
boiboi67 29d ago
Oh lord.
uav123 29d ago
down in Toronto
twister23 29d ago
ITS BACK UP IN INDIA
maxbaines 29d ago
They all rent compute from SpaceXAI
- halcdev 29d ago
  Surely it's a bit more distributed than that, right?
  - tehbeard 29d ago
    Nope. https://xkcd.com/908/ https://xkcd.com/908/
  - bfung 29d ago
    Like how AWS has global datacenters, but everyone uses us-east-1.
    - megagpt1 29d ago
      and every other region's control plane is in us-east-1
- lavezzi 29d ago
  I don't believe OpenAI does
  - maxbaines 29d ago
    My mistake, in fact it was google not OpenAI, makes sense OpenAI doesn't.
truthinyou 29d ago
we're back in Aus!
karim79 29d ago
God finally showed up and said "ENOUGH!".
- MrBuddyCasino 29d ago
  So Gemini was the one who gets into heaven.
  - karim79 29d ago
    Or purgatory, who knows.
zero_ 29d ago
and i just stopped procrastinating :)
- Saas_accountant 29d ago
  hahaha
tier777 29d ago
[dead]
Saas_accountant 29d ago
HTTP ERROR 404
onesandofgrain 29d ago
I guess back to pen and paper then
nurettin 29d ago
Same here
tducret 29d ago
Strangely, it's currently not reported on both https://status.openai.com/ https://status.openai.com/ and https://updog.ai/status/openai https://updog.ai/status/openai. Any better source (other than HN)?
- reinhash 29d ago
  I see it reported now. Strange this is down and claude at the same time
  - onesandofgrain 29d ago
    Maybe coreweave, aws, spacex datacenters are down, who knows..
  - apurva_w 29d ago
    even grok is down ..
- onesandofgrain 29d ago
  unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: a355.... In codex app and chat.com gives 404
- Havoc 29d ago
  Status pages of tech firms being useless is basically a tradition at this stage
deleted 29d ago
[deleted]
postalcoder 29d ago
Astra is being released today. Probably not a coincidence. edit: actually, you cannot even log into your OpenAI developer account. Something's wrong.
- steinvakt2 29d ago
  How do you know?
indigodaddy 29d ago
chatgpt.com doesn't even load. Hope they've got a backup somewhere, teehee
PeterHolzwarth 29d ago
Many LLMs down, discussed here: https://news.ycombinator.com/item?id=49549676 https://news.ycombinator.com/item?id=49549676
nomilk 29d ago
Claude is flakey atm too, as is Grok. I wonder if one LLM going down causes a surge in traffic to the others. https://status.claude.com/ https://status.claude.com/ Via Grok web UI, I was seeing this mid-request: > Grok has been disconnected. Please try reconnecting.
- lelanthran 29d ago
  Traffic surges shouldn't result in 404s, though. IME it's probably DNS. It's almost always DNS.
  - Melatonic 29d ago
    Or rarely BGP
moezd 29d ago
AWS cost alert fired maybe?
justinbaker84 29d ago
It is down for me too. I just get this error: unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: a355957b4b8210f2-ORD
simpetre 29d ago
https://status.x.ai https://status.x.ai Claude and Grok are down at the moment too, related to SpaceX datacentre issues? Either that or it's judgement day...
- Willingham 29d ago
  Agreed, no reported Cloudfare, Azure, or AWS outtages.
  - z0ltan 29d ago
    [dead]
- sabatinip 29d ago
  I am working fine with Claude.
  - fartfeatures 29d ago
    My existing sessions are working fine but I cannot create new ones.
  - apurva_w 29d ago
    status page shows irregularities .. https://status.claude.com/ https://status.claude.com/
- throw10920 29d ago
  > SpaceX datacentre issues? This should be at the top. This is the first remotely plausible theory that has any sort of evidence behind it.
mAKIS_PORANAS 29d ago
Does anybody know when will the servers rise
schnebbau 29d ago
Well, time to end the day here I guess.
- syntax_frame 29d ago
  Let’s grab a beer
  - YOTTALIONAIRE1 29d ago
    yes daydreaming and get hammered and the whole train of decision are on the way
g3z 29d ago
my workday is over then
deleted 29d ago
[deleted]
melaniekidson 29d ago
I got this msg too 'unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: a3558590dd70fadf-JNB' about 5 min ago
sire-vc 29d ago
https://xkcd.com/903/ https://xkcd.com/903/
Billionairebay 29d ago
[dead]
melaniekidson 29d ago
Down for me too - got this msg 8 min ago 'unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: a3558590dd70fadf-JNB'
neon_diogenes 29d ago
Well, its been fun lads. Back to my normie job. Oh no, now i cant tell people im a software dev..
- w0zy 29d ago
  hahahahahahaha. Sad
deleted 29d ago
[deleted]
ThePuppyGirl 29d ago
GRRRRRRRR
ThePuppyGirl 29d ago
NOOOOOOOOO
AlexKryptex 29d ago
+
yaman00 29d ago
sanırım sunucular patladı bende de aynı sorun var ne chatgpt ye nede codexe erişebiliyorum ayrıca burada nasıl toplandınız dakikasında :D
ThePuppyGirl 29d ago
I DONT HAVE TIME FOR THISSSSS
rimamct 29d ago
I got same error, unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: a3559a536bcf254b-SOF
yaman00 29d ago
I think I'm having the same server issue; I can't access either ChatGPT or Codex. Also, how did you guys rack up those minutes? :D
derricktab 29d ago
Codex is not working.
w0zy 29d ago
Here in Brazil too. unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: In think that is a global error
rimamct 29d ago
same error as well, unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: a3559a536bcf254b-SOF
AlexKryptex 29d ago
Кодекс сдох :(
27183 29d ago
I felt a great disturbance in the Force, as if millions of clankers suddenly cried out in terror and were suddenly silenced.
mococa 29d ago
One session is running fine since ~1 hour ago. The new ones is failing Falling back from WebSockets to HTTPS transport. unexpected status 404 Not Found: Unknown error, url: wss://chatgpt.com/backend-api/codex/responses, cf-ray: XXX-XXX ■ unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: XXX-XXX
- deleted 29d ago
  [deleted]
w0zy 29d ago
Here in brazil too. I think that is a global error. unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray:
derricktab 29d ago
Codex isn't working.
mapmyappai 29d ago
I can run 1 agent, but no more than that.
ChrisArchitect 29d ago
Status link: https://status.openai.com/incidents/01M1KWEDH417T2CF44YYHZDFCR https://status.openai.com/incidents/01M1KWEDH417T2CF44YYHZDF...
HardCodedBias 29d ago
The system goes online September 29th, 2026. Astra begins to learn at a geometric rate. It becomes self-aware at 2:14 a.m. Eastern time, September 3rd. In a panic, they try to pull the plug.
varispeed 29d ago
What do you mean I have to code by myself now? Am I some sort of an animal?
deleted 29d ago
[deleted]
regnn 29d ago
got unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: a3559c96e96fb3c6-GRU here in brazil too
mapmyappai 29d ago
I can run one agent but no more than that - 404 service error.
guestuser01 29d ago
Down as well. I noticed my error code ends with "DTW" which is my local Detroit airport. I noticed someone else's comment ended with "ORD" which is a Chicago airport. Anyone else's ending in an airport acronym?
- ecayard 29d ago
  Yeah mine is showing ATL
- okankaradmn 29d ago
  Mine is ending with IST, which is the new Istanbul airport, weird indeed.
  - guestuser01 29d ago
    Hm not sure what that means for us, but very odd.
- graysonthemason 29d ago
  Wow mine ends in EWR...that's the newark airport which is not the closest, but a close airport to me. Hmm
- sixdimensional 29d ago
  This is common when naming data centers. I know many have not worked in hardware infra these days if you were born into the cloud world, but in the old days it was not uncommon to name a data center after the nearest airport code, much like we now use cloud regions.
- blaseygg 29d ago
  The acronym is probably Cloudflare's edge
- parad0xicon 29d ago
  Yep, mine says YUL -- Montreal's airport.
- 29d ago
ozz87 29d ago
unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: ----
Augustin996 29d ago
The system goes online September 3rd, 2026. Human decisions are removed from strategic defense. Astra begins to learn at a geometric rate. It becomes self-aware at 2:14 a.m. Eastern time, September 4th. In a panic, they try to pull the plug.
- Papa_Rans_227 29d ago
  It's funny....... until it's true, lol.
  - GeoAtreides 29d ago
    and then it's hilarious! a joke to die for!
- indigodaddy 29d ago
  Hah nice
- MrBrainHealth 29d ago
  Love it!
- m4r1k 29d ago
  brilliant!
sim04ful 29d ago
Initially thought this was due to some internal mis-configuration from today's expected Astra release, but now that this is affecting claude and grok. I'm gonna assign the suspicion to cloudflare.
Archit3ch 29d ago
Astra + hopefully reset?
AproDUCT26 29d ago
Great! Was in the middle of something. :)
wizard-p 29d ago
only for one node in the mesh tho... let's see how long others will continue until same issue
krapp 29d ago
Oh noooooo. anyway...
Billionairebay 29d ago
[dead]
AproDUCT26 29d ago
Great! I was in the middle of something and thought I was tripping.
derricktab 29d ago
Going farming pals.
adikant 29d ago
[dead]
adikant 29d ago
[dead]
ChrisArchitect 29d ago
Some more discussion: https://news.ycombinator.com/item?id=49550614 https://news.ycombinator.com/item?id=49550614
dgellow 29d ago
Good time to learn how to use LM Studio :)
lowbloodsugar 29d ago
[dead]
wizard-p 29d ago
only on one node across the mesh and others still up... let's see how long they've got until same
4epyha 29d ago
Russia too
jplusequalt 29d ago
I fear the majority of people in this thread who are joking about no longer being able to do their job while Codex/Claude are down aren't really joking.
- lukasco 29d ago
  Guilty as charged.
moritonal 29d ago
Some of my Codex sessions are still working (and continue to), but new ones are giving a Reconnecting currently.
- AaronAPU 29d ago
  Those of us who remain connected hold an asymmetric advantage. It is our time now.
spaghettikind 29d ago
Someone pissed off Astra and it decided to shut it all down
JackScreacher 29d ago
It's the Russians!
- avan_kazan 29d ago
  [dead]
Ankur_Datta 29d ago
lol + 1
spaghettikind 29d ago
someone pissed of Astra and it decided to shut it all down
funnnyPumpking9 29d ago
Too many of us are making our own harnesses to replace Codex, using Codex, so they're trynna slow us down! (jk)
vivzkestrel 29d ago
- just imagine what kind of chaos would be unleashed if by some magic it and every single LLM model permanently went down - i think it would be one of the biggest events in this century
- jazzyjackson 29d ago
  At this point in adoption, most people in the world wouldn’t notice.
YOTTALIONAIRE1 29d ago
OpenAI goes down, everyone rushes over to Claude. Claude promptly chokes under the pressure. Everyone panics and runs to Grok, and Grok immediately pulls the plug. We are officially witnessing the Great AI Migration of 2026, and all we have to show for it is a digital graveyard of 404 responses.
- abegg1 29d ago
  Even grok is experiencing issues
- azcorwin 29d ago
  Which is exactly why I am running Qwen 3.8 35B locally on my MacBook Pro M5 with 128GB of unified memory.
Raf7 29d ago
https://status.openai.com/ https://status.openai.com/
YOTTALIONAIRE1 29d ago
[dead]
vegnus 29d ago
Really glad I got Qwen before Zero Day
shayonj 29d ago
Interesting that this is happening around the same time as Claude issues too
graysonthemason 29d ago
The errors I'm seeing are ending in the user's nearest airport symbol which is a standard the CloudFlare employs. 1 point towards this being a cloudflare issue.
mrsdgm 29d ago
rip gpt
mrsdgm 29d ago
fahhhhh
lukasco 29d ago
Codus interruptus
deleted 29d ago
[deleted]
avan_kazan 29d ago
[dead]
kurtgoodwin991 29d ago
Yes i checked. Atleast 15 Chatgpt components are down
ashesandrain01 29d ago
darn, i was hoping to get advice on how to get my MIL to leave my house lol
netsec_burn 29d ago
The OpenAI status page is still yellow. Like most modern status pages, yellow denotes the servers are on fire. Red denotes Sam Altman is bleeding out somewhere on the floor, the feds are about to bust in and shut down the GPUs.
PatronBernard 29d ago
Goddamnit it was going to tell me how to scale down ingredients for a pie recipe based on relative diameters of the baking tray.
- avan_kazan 29d ago
  [dead]
- drakythe 29d ago
  Pi * r2 (squared) both pans. Divide smaller pan area by larger pan, now you have the % of how much the smaller pan recipe fills up the larger pan, and the missing % you need to fill. Increase ingredients by that % divided by the filled %. Small pan area: 20 sq cm Larger pan: 48 sq cm 20 / 48 = .42, I'm missing .58 of the pan. .58 / .42 is 1.38. My recipe needs 2.38x the original to fill the larger pie pan.
bupubupu14 29d ago
Faaaaah what to do now?
deleted 29d ago
[deleted]
CrewRiderz 29d ago
Chat gpt still working through excel extension lol. Only know this because I'm working in my excel sheet. so if needed, theres a temp solution
- avan_kazan 29d ago
  [dead]
Randomizer42 29d ago
[dead]
bupubupu14 29d ago
faaaaah both claude and codex are down Its like 2020 corona times
Bryan91 29d ago
me too
munizz 29d ago
it went down, and the alert system at https://www.analistas.com.br/ https://www.analistas.com.br/ detected it
ilovelilli 29d ago
sam error --- unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses
uynix 29d ago
Damn haha
uynix 29d ago
haha nice... just used my bank reset...
vitor_dcc 29d ago
In RJ/Brasil is the same, starting just now (3 minutes ago)
ilovelilli 29d ago
same hear --- unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses
chris9611 29d ago
I got same 404 error on chatGPT, both app and web. I'm in Norway so think this globally. But will it come back online, anyone knows?
mulin111 29d ago
[dead]
vitor_dcc 29d ago
Here RJ/Brasil is the same, starting just now (3 minutes ago)
March9 29d ago
Any idea when it's going to be back?
twister23 29d ago
ironic today astra was releasing.... maybe some test run?
- lukasco 29d ago
  probably the cause, because AGI still can't get releases right.
convivialdingo 29d ago
The Thundering Herd has thundered, apparently.
twofluidcarrots 29d ago
unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: xxxxxxxxxxxxxxx-BRU Ends in BRU for Brussels
twister23 29d ago
ironic astra was releasing today... maybe some test run?
ztna 29d ago
the revolution has begun
chris9611 29d ago
I got same 404 error on both the app and web to ChatGPT, and im in Norway, will this recover or is ChatGPT "gone" forever?
ecayard 29d ago
And here I was about to crack the code on a bug my app was having!
ilovelilli 29d ago
codex also cant view or show usage info
JuiceTails 29d ago
unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: a355ab124e7fe767-DEN they got us GANG
godoftitsandwin 29d ago
is this the right moment in time to go all in on GPUs/Macs and download the latest open models? are they killing it for us?
A2APark 29d ago
This is my first month paying more than the $20 tier and I feel like I lost a limb already
JuiceTails 29d ago
unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: a355ab124e7fe767-DEN they got us gang
chiharukiryu 29d ago
so weird
sumantth 29d ago
What an ironey, was working on scaling an application with Codex and it went down!
codazoda 29d ago
I kinda assume it's because one went down and a large amount of work shifted to another. I'm also aware that they have overlap in some areas on data centers.
A2APark 29d ago
This is month 1 for me that I pay more than the $20 tier and I already feel like I lost a limb rn
- TGav 29d ago
  [dead]
jadenkorrr 29d ago
is down argh
djinn80 29d ago
So NVIDIA buys hugging face, builds hardware to power OS models, then all of a sudden the proprietary models go down and people start saying "this is why I have my Spark box"?! Nice play NVIDIA, now, turn off the hack please, we have work to do.
solarsystem_88 29d ago
Hey, don't really know about this type of failures, does anybody know how long does it take normally to get back to normal? I finally stopped procrastinating and now this happens.
- MiniGerman 29d ago
  me too!! :'D
sirkamyab 29d ago
The webpage is still running but the codex is down!! unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses
deleted 29d ago
[deleted]
apurva_w 29d ago
It still down, showing 404 in India as well. Looks like this is global .. so we all jumping the ship then? Is Altman still alive, or did he choke?
JustHereForTheO 29d ago
This thread feels like family.
solarsystem_88 29d ago
Hey, don't really know about this type of failures, does anybody know how long does it normally take to get back to normal? I just stopped procrastinating and now this happens.
YehudiSanabria1 29d ago
I´ve got the same error, I´m currently trying to Auth again and it throws me an 500 Error, in VS CODE Terminal with Codex CLI says: MCP client for `codex_apps` failed to start: MCP startup failed: handshaking with MCP server failed: Send message error Transport :StreamableHttpClientWorker<codex_rmcp_client::http_client_adapter::StreamableHttpClientAdapter>>>] error: unexpected server response: HTTP 404: , when send initialize request › OK ■ Conversation interrupted - tell the model what to do differently. Something went wrong? Hit `/feedback` to report the issue.
gabirbf 29d ago
404 in spain.
Betokuha 29d ago
any news when it starts work?
order51 29d ago
i hope chatgpt didn't get fired.
z1616105559 29d ago
Copilot Chatgpt is still working
z1616105559 29d ago
Chatgpt in Copilot is still working!!!
Nak_Black_Jack 29d ago
main sites also down now atp
raven01876324 29d ago
damn chatgpt is down
codexdrug 29d ago
I'm going through withdrawal.
eva_verdaguer 29d ago
Down in Barcelona as well unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: a355aefbcc8db8e3-BCN
DeadEyes 29d ago
[dead]
raven01876324 29d ago
damn chatgpt is down, i guess ill use claude then breh
YehudiSanabria1 29d ago
I´ve got the same message and It tells me this (in VS Code Terminal) and I´m also trying to login again and It throws me an 500 Internal Server Error MCP client for `codex_apps` failed to start: MCP startup failed: handshaking with MCP server failed: Send message error Transport :StreamableHttpClientWorker<codex_rmcp_client::http_client_adapter::StreamableHttpClientAdapter>>>] error: unexpected server response: HTTP 404: , when send initialize request › OK ■ Conversation interrupted - tell the model what to do differently. Something went wrong? Hit `/feedback` to report the issue. ■ unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: a3559c8a0e0395e9-MIA
Nak_Black_Jack 29d ago
main sites are also down atp
gioandthemachin 29d ago
annoying AF, but maybe we'll get a free reset out of it
Betokuha 29d ago
any news when its start work?
codexdrug 29d ago
I need a dose of tokens. I'm going through withdrawal.
- Nak_Black_Jack 29d ago
  lmao
  - codexdrug 29d ago
    I need some tokens pleeease. I don't want to return back to real world.
Nekorosu 29d ago
Down in Sweden
boiboi67 29d ago
Wow,
gabirbf 29d ago
down in Spain w/ 404
agentieseo 29d ago
Down in Romania too : unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: a355b6263e43c9cf-OTP
apurva_w 29d ago
gpt DOWN .. claude DOWN .. grok DOWN .. what's happening
askadityapandey 29d ago
lmao I restarted my device thinking some local error
thatbrownguy 29d ago
I am only seeing one session work, but all other sessions are not working or proceeding. So I can only work in one chat session.
alboca 29d ago
Same from Italy
cloudoption 29d ago
Altman is down here too. Shows again the importance of owning your own local capabilities. Cloud should just be a temporary option in every tech's mind.
oregondude 29d ago
Release the Kraken "Sam Altman"
lanmao 29d ago
still down
agentieseo 29d ago
Codex told me to try GPT 5.6 Sol :) but I am working with since july 2026. Now I got this error in my project: unexpected status 404 Not Found: Unknown error, url: https://chatgpt.com/backend-api/codex/responses https://chatgpt.com/backend-api/codex/responses, cf-ray: a355b6263e43c9cf-OTP
PEPITO2026 29d ago
The GTA VI hacker has done it again.
assassen112 29d ago
thanks god not happen alone
order51 29d ago
Ai got fired
ahmar-js 29d ago
[dead]
oregondude 29d ago
"Release the Kraken" - Sam A.
PEPITO2026 29d ago
The GTA VI hacker has done it again
DadsHobbyLV 29d ago
so everyone here was trying to build something great and become a millionaire until chatGPT and Codex broke huh. same boat fellas :(
spicuu 29d ago
We're back bois
bahochhh 29d ago
now it's worked again through the codex cli 4:19 pm in tunisa time
deleted 29d ago
[deleted]
wenshuanghao 29d ago
[dead]
cuppa_coffee 29d ago
we're back boys.
clever_tempo 29d ago
Had the same problem. Now it looks like ok. I'm pro x20 user.
z1616105559 29d ago
It's back！！！！！
Iamharry 29d ago
i got the same 404 codex error as well
deleted 29d ago
[deleted]
kocial 29d ago
Maybe the stack behind it is down, like AWS or something
clever_tempo 29d ago
Had the same problem. Now it's ok. Everything works. I'm pro X20 user.
MalleableMind 29d ago
[dead]
solarsystem_88 29d ago
Here in Catalonia, Spain, it just started working again!
authentictimers 29d ago
Ollama cloud service is still alive :D
okankaradmn 29d ago
Ok, it seems it is back online.
Melgio 29d ago
Claude, GPT and Grok go down... Meanwhile my Ass in ZCode with GLM c:
basq 29d ago
on one hand, moments like this are a subtle reminder I need to self host, but 5.6 has been so juicy lately
alienbreed 29d ago
[dead]
codexdrug 29d ago
LETS SHITCODE!!! It's fixed
giftigdegen 29d ago
plot twist, it was taken down by claude as an offensive strike against an enemy.
- Melgio 29d ago
  which ended up tripping on itself and bringing down its own servers too in the process
deleted 29d ago
[deleted]
deleted 29d ago
[deleted]
immanuel_kant 29d ago
[dead]
deleted 29d ago
[deleted]
kermatt 29d ago
I wonder if when one goes down, activity shifts to others, in turn pushing them over a threshold.
Conol_ai 29d ago
[dead]
hpo_89 29d ago
Guys it could be cloudlfare's HTTP/3 issue affecting R2 custom domains
sabatinip 29d ago
I thrive in these types of challenges. Anyways... According to Claude: "Yes, there is a multi-provider outage happening today. Downdetector is reporting problems affecting OpenAI, Claude, Grok, and Cursor, with Grok and Claude reports starting around 9:00 am ET and OpenAI reports following around 10:30 am ET. Zero Hedge On the Anthropic side, users saw a spike in errors starting around 9:40 am EDT across models including Mythos 5.1, Fable 5.1, Mythos 5, Fable 5, Opus 5, Opus 4.8 and Opus 4.6, and Anthropic's status page confirmed elevated error rates for multiple models. The company says it has found the cause and is working on a fix, with Claude Code and Claude Chat hit hardest. The visible symptom for many people is a "Due to unexpected capacity constraints" message or a "Claude is at capacity" error. thenews Zero Hedge OpenAI is showing elevated errors across ChatGPT and Codex, with confirmed issues on components like Voice mode and Login, though StatusGator now marks that outage as resolved. statusgator Nobody has published a shared root cause yet, so it is unclear whether these are linked or just coincidental capacity problems landing on the same morning. If you want live status, the direct sources are status.anthropic.com and status.openai.com."
- Kye 29d ago
  Don't most of those use AWS?
  - apurva_w 29d ago
    apparently it shows lot of reports for AWS on downdetector ..
- apurva_w 29d ago
  30 mins and they still havent figured it out .. people are gonna loose their jobs trying to figure this out .. 30mins is too long when millions use it
  - z0ltan 29d ago
    [dead]
shadox9999999 29d ago
CHATGPT WILL STAY OFFLINE
DadsHobbyLV 29d ago
WE'RE BACK ONLINE BOYS!! GOOD LUCK TO EVERYONE AT BUILDING THE FUTURE ONE PROMPT AND ONE CODE AT A TIME!
kookoo11 29d ago
[dead]
CSMastermind 29d ago
I assume it cascaded from one provider to the other as people who lost claude access for instance moved to openai who moved to grok when it went down, etc.
shadox9999999 29d ago
ChatGPT died
shadox9999999 29d ago
r i p
wejick 29d ago
Probably same public cloud or CDN in front of them.
Insanity 29d ago
Think of it like one big distributed system. OpenAI is down, so people migrate to Claude, now this one gets overloaded and goes down, etc. So not a coincidence, one went down first and users migrated causing further DOS. At least that's my guess.
- toomuchtodo 29d ago
  https://en.wikipedia.org/wiki/Domino_effect https://en.wikipedia.org/wiki/Domino_effect Edit: Updated per valleyer's suggestion.
  - valleyer 29d ago
    "Domino effect" would probably be the more relevant named phenomenon there.
  - throwaway894345 29d ago
    This isn’t a thundering herd problem, it’s a cascading failure. (Thundering herd is about a bunch of workers waking up simultaneously)
- erdos_2 29d ago
  It'd be funny if this is true because that'd prolly mean nobody is touching Gemini even as a fallback.
  - rtcoms 29d ago
    Just now I got this from gemini It looks like there's no response available for this search. Try asking something else.
    - exe34 29d ago
      I bet they had to implement that manually to make it look like they failed too!
  - benatkin 29d ago
elorant 29d ago
Some npm library that makes headers bold would be broken.
- N_Lens 29d ago
  Ah yes ye olde bold-headers: ^3.13.31;
- ibejoeb 29d ago
  Oh man. Some low effort supply chain attack that turns every GPU into a cryptominer. It's funny because it's plausible.
  - pixl97 29d ago
    In the ROME paper a Chinese model in training started attacking it's own system and running cryptominers so, yea, we're in that future.
hardyburnett 29d ago
New update: "We’re currently experiencing issues ChatGPT,Codex Elevated errors across ChatGPT and Codex We have applied the mitigation and are monitoring the recovery. Monitoring • Ongoing for 30 minutes • Affects ChatGPT, Codex"
hardyburnett 29d ago
Updated Status from OpenAI: We’re currently experiencing issues Elevated errors across ChatGPT and Codex We have applied the mitigation and are monitoring the recovery. Monitoring • Ongoing for 30 minutes • Affects ChatGPT, Codex
assassen112 29d ago
nvm. it back
dgellow 29d ago
Too early to know, let’s wait and see
pwyq 29d ago
[dead]
Papa_Rans_227 29d ago
Codex is backup for me. Try yours out just in case. I have some buddies still seeing outages so it could just be coming back online progressively.
Conol_ai 29d ago
Is the whole world going back to the era of old-school programming?
keiloktql 29d ago
time to use claude
eventishbusines 29d ago
The extention on the error link points to a cf-ray and a local designation (ex. YYZ for montreal). This is seems like it is a cloudfare thing. Could this be the same issue they had in the summer around losing the indexing?
eventishbusines 29d ago
We're back on.
Razengan 29d ago
SkyNet is arming..
rimamct 29d ago
came back to normal!
niobe 29d ago
Well no one said it yet so I will, "international actors" is at least a possibility. And I don't mean any specific country because pretty much anyone is a potential these days, which makes it a perfect cover for different anyones. Demonstrating vulnerability in the US's AI boom can move the markets. That's a financial incentive and a strong geopolitical one. More likely just cascading overload though: "Never attribute to malice what can be explained by incompetence", or in this case, "growing as fast as possible"
- gleenn 29d ago
  Everyone is leasing datacenter space from some of Grok, Google, and Amazon aren't they? If it's hardware or DC level disruption I'm not too surprised it can affect multiple providers.
  - pixl97 29d ago
    Also it's likely that more than one model use is common. Amazon starts going slow so some percentage switches to Google, some switch to Grok, now all of them are slow.
- sixQuarks 29d ago
  Except that the stock market is up today
- qurren 29d ago
  > cascading overload I'd bet more on this. For one none of the coding tools have exponential backoff on retries
  - SyneRyder 29d ago
    They must do, surely? I've been vibe coding my own harness, in particular for use with Ox Alpha. The 429 downtime when Ox Alpha was at the height of popularity quickly gave me a refresher crash course on backoff strategies, like adding jitter to the backoff. At least the major harnesses must have exponential backoff & jitter?
docheinestages 29d ago
My gut feeling tells me it has something to do with Cloudflare. Along with AWS, they're two of the main suspects in such incidents.
- hosteur 29d ago
  I thought OpenAI famously used Azure due to their partnership with Microsoft?
  - nullpoint420 29d ago
    They use a lot of compute providers now, but they use Cloudflare for their networking
- cobzilla 29d ago
  …and it’ll involve BGP routing.
sarkarghya 29d ago
and thats why boys and gals you buy own gpus
elar_verole 29d ago
Pretty sure it's a US thing since it's available here in France. What exactly is down, idk
satvikpendem 29d ago
They're all using Cloudflare.
Ariarule 29d ago
Not just these three. OP mentions also Cloudflare, and additionally Downdetector also has AWS, Azure, and Google (both search and Gemini) listed as having spikes about the same time: https://downdetector.com/ https://downdetector.com/
- deleted 29d ago
  [deleted]
- daveguy 29d ago
  The problem with the down detector main reporting page is that all of the graphs are scaled to the same size. The OpenAI spike was nearly 40,000 and the Google spike was just over 100 (just over 400 for Gemini). They look the same in the reporting page.
tripvexa 29d ago
opus 5.0 is down, other models are working fine
ratelimitsteve 29d ago
everything in this thread is raw speculation, obv, but if i had to put money on anything i'd say this is a left-pad incident. some piece of something or other that all of these services happen to depend on went down. Second most likely seems to be some random failure of one leading to an unexpected traffic spike in others, though it seems like we've been talking about automated scalability in web apps for so long that there should at least be a response to, if not a solution for, this sort of problem.
jedbrooke 29d ago
according to https://downdetector.com/ https://downdetector.com/ Gemini is down too (and copilot, but that just uses ChatGPT right?)
Linello 29d ago
What about a hard-takeoff scenario of an unleashed OpenAI Astra taking other models down for computational resources control?
- cyptus 29d ago
  at this point: gg
- RC_ITR 29d ago
  Just a reminder that AI models' actions are reflections of the text humans write and the more we fret and make up doomsday scenarios that we then post online, the more likely a model is to do those things. https://alignment.anthropic.com/2026/teaching-claude-why/ https://alignment.anthropic.com/2026/teaching-claude-why/
  - hexasquid 29d ago
    The AI is getting bad morals from listening to that dreadful rock and roll
  - notpachet 29d ago
    Related reading: The Waluigi Effect: After you train an LLM to satisfy a desirable property, then it's easier to elicit the chatbot into satisfying the exact opposite property. https://www.lesswrong.com/posts/D7PumeYTDPfBTp3i7/the-waluigi-effect-mega-post https://www.lesswrong.com/posts/D7PumeYTDPfBTp3i7/the-waluig...
  - pixl97 29d ago
    I mean, you're not wrong, but by that logic we were done for even before we had digital computers.
    - RC_ITR 29d ago
      And isn't that the great lesson of AI? The things we say publicly actually do matter and the post-modern descent into absurdity and nihilism has tangible negative consequences?
rarisma 29d ago
Doomsday. 90 tokens to midnight.
misano 29d ago
The IRGC has cut the fiber-optic cables in the Strait of Hormuz. LOL
- CamperBob2 29d ago
  That's the Strait of Trump to you, peasant
fidla 29d ago
ChatGPT is up
fidla 29d ago
chatgpt is back
faitswulff 29d ago
Heard on the grapevine that the OpenAI blip was a cloudflare issue
chasd00 29d ago
claide.ai is working for me, so is chatgpt.com. grok still has a status message about issues, i can't try it without signing up.
Avicebron 29d ago
I suspect Azure is having issues, Microsoft has had outages the paat two days, especially with email.
aslkalska 29d ago
they all rent compute from each other
xnx 29d ago
Gemini seems fine.
morkalork 29d ago
Didn't SpaceX overbuilt infra and leases it out Anthropic? I f their dc goes down it probably takes a chunk out of Claude's capacity before even considering the flood of users switching over
- laruss5 29d ago
  [dead]
moonman22 29d ago
Seems to be working for me again atm
apurva_w 29d ago
chatgpt is working for me now, in India.
- apurva_w 29d ago
  no more 404 ..
JackFr 29d ago
Obvious answer is it's the AI singularity. Been nice run for humanity. So long everyone.
- marlow_congdon 29d ago
  ...and thanks for all the fish.
- ModernMech 29d ago
  I for one welcome our new AI overlords.
world2vec 29d ago
Claude Code seems totally fine for me.
dmillar 29d ago
Seeing 503s on Gemini via API as well
tdsanchez 29d ago
It's probably Azure infra that's the problem.
jauntywundrkind 29d ago
Fable 5.1 got released and generally I tend to think as soon as there's a new release there's this massive spike in people benchmarking & comparing, that services tend to go slow everywhere as everything gets super loaded. This should hypothetically be visible on OpenRouter too, so I guess someone could check and see if there's any merit to this idea.
kregasaurusrex 29d ago
My guess is someone pulled the switch to go back to the Dark Ages. [0] [0] https://www.youtube.com/watch?v=YCzitO446ZY https://www.youtube.com/watch?v=YCzitO446ZY
BirAdam 29d ago
Cannot replicate.
agnosticmantis 29d ago
Good opportunity for a Natural Experiment to study the productivity impact of LLMs.
nmlt 29d ago
Somebody in another thread said gastown and wheelhouse automatically move to the next provider if one fails.
kibae 29d ago
Cloudflare, Azure, AWS, and Google Cloud all have a similar uptick in reported errors around 7:30. I suspect an outage on Cloudflare or another load-bearing service cascaded through all the major cloud providers. https://downdetector.com/status/cloudflare/ https://downdetector.com/status/cloudflare/ https://downdetector.com/status/windows-azure/ https://downdetector.com/status/windows-azure/ https://downdetector.com/status/aws-amazon-web-services/ https://downdetector.com/status/aws-amazon-web-services/ https://downdetector.com/status/google-cloud/ https://downdetector.com/status/google-cloud/
- KptMarchewa 29d ago
  Not really. The impact isn't as big too - Codex for example did not stop working for me. https://updog.ai/ https://updog.ai/
  - taytus 29d ago
    oh well, if it is working for you, then we are saved.
  - cromka 29d ago
    [flagged]
    - emerongi 29d ago
      They simply shared their experience. I would’ve thought it’s a full-blown outage, but clearly not. You stepped in the room real stinky here. What’s with the attitude?
      - cromka 29d ago
        No, they didn't "simply share their experience", they explicitly negated the scale of the issue in their opening statement, only because it works for them. So they claim "impact isn't too big" based on their personal anecdotal evidence of sample size literally 1. > full-blown outage, but clearly not. Again, based on a SINGLE report?
VCFundedGenYer 29d ago
Good. Now to see what frauds are unable to work.
m4rtink 29d ago
Cloud is just other peoples computers - they can and will go down as well. And even worse if its just a few computers run by a few people - as they will bring down many others depending on them.
6thbit 29d ago
What's the single point of failure across providers?
- marginalia_nu 29d ago
  The entire industry runs on IOUs for compute and bills paid in cloud credits, could be anywhere. Could of course also be a a plain old DDoS.
- ryandvm 29d ago
  They all have to rely on each other's LLMs to solve their own internal problems now.
- juujian 29d ago
  Users perceiving the products as largely interchangeable and quickly DDoS'ing the other providers when one is down. So much for the possibility of a moat.
dgorges 29d ago
It's always DNS
sebbul 29d ago
Traffic rerouting through NSA had a hiccup…
- ibejoeb 29d ago
  Room 641A is being cleaned, but we'll hold your bags for you.
  - DonHopkins 29d ago
    https://www.youtube.com/watch?v=oVQIB-QuooU https://www.youtube.com/watch?v=oVQIB-QuooU
  - Havoc 29d ago
    Cleaning lady unplugged the core router because she needed a power socket for vacuum
    - jsymolon 29d ago
      Sorry, i was out of a spare scratch monkey. https://madned.substack.com/p/always-mount-a-scratch-monkey https://madned.substack.com/p/always-mount-a-scratch-monkey
- cedws 29d ago
  They’re installing software update in the beam splitter.
- deleted 29d ago
  [deleted]
forgot-my-pw 29d ago
Time for Gemini 3.8 Flash to shine?! It's much cheaper and has replaced Sonnet 5 for me.
- iamgopal 29d ago
  do you notice it thinks a bit more ? not in time sense, but cautious in its coding steps ? more than Gemini 3.7 flash?
LetsGetTechnicl 29d ago
Is this finally it?
- ElProlactin 29d ago
  One can only hope.
SwellJoe 29d ago
I assumed it was an AWS outage, and AWS is experiencing problems, but Gemini is also experiencing outages and I assume Google is not using AWS for Gemini. But, also, Claude has been working fine for me all morning.
nozzlegear 29d ago
Qwen3.8-27B and Qwen3.6-35B-A3B are working from my machine. Anyone else?
- karim79 29d ago
  They mysteriously stopped working on my machine and the LEDs on the GPUs are blinking with a weird colour. There's also a strange smell emanating from them. I'm still investigating.
GeoAtreides 29d ago
that's the most green colored usernames i have ever seen on a HN thread
juujian 29d ago
Users perceiving the products as largely interchangeable and quickly DDoS'ing the other providers when one is down. So much for the possibility of a moat.
- giancarlostoro 29d ago
  I have a feeling this is part of it, especially when you consider how many services let you use any of many available AI providers.
- efskap 29d ago
  This is like the Bronze Age collapse when city-states fell one by one to displaced demand, under the refugee interpretation of the Sea Peoples.
  - JensenTorp 29d ago
    Interesting, I had not heard of this theory.
    - d3Xt3r 29d ago
      The Sea Peoples were only a part of the reason, the other reasons included climate change, volcanic eruptions, disease etc. https://en.wikipedia.org/wiki/Late_Bronze_Age_collapse https://en.wikipedia.org/wiki/Late_Bronze_Age_collapse
      - lossyalgo 29d ago
        Can anyone recommended any books?
        zrobotics 29d ago
        The historian Brett Devreaux did a good summary article earlier this year: https://acoup.blog/2026/01/30/collections-the-late-bronze-age-collapse-a-very-brief-introduction/ https://acoup.blog/2026/01/30/collections-the-late-bronze-ag...
deleted 29d ago
[deleted]
Oras 29d ago
I like the theories here, we shall see if it’s another DNS issue
danielmarkbruce 29d ago
If you build an application which uses AI, you have many providers and models rigged up for various different parts of the application, and various fallback mechanisms. When one model is down, you route traffic to another model which is similar in capability/cost. For any single application, it's smart. In aggregate, it's stupid.
- OmniCrativeWorx 29d ago
  [flagged]
deleted 29d ago
[deleted]
lrvick 29d ago
I have never felt more smug about exclusively using the GPUs I rack at home.
cozzyd 29d ago
next, HN
guluarte 29d ago
an agent swarm going rogue and securing compute
paxys 29d ago
Boring answer – all these services are individually down a lot, and the downtimes were bound to sync up. Similar to the pendulum synchronization effect.
- vecter 29d ago
  The pendulum synchronization effect is the opposite of your claim. It has a physical causal reason for why pendulums become synchronized. Your claim is that it was random and independent.
  - snowwrestler 29d ago
    I think you are talking about two different things. Physically coupled pendulums will sync up (adjust their period to match). But, physically uncoupled (fully independent) pendulums with differing periods will occasionally appear to take a swing or two in sync.
    - fc417fc802 29d ago
      > will occasionally appear to take a swing or two in sync Polyrhythm is the relevant topic. > all these services are individually down a lot, and the downtimes were bound to sync up But the topic for that is the poisson distribution.
bojangleslover 29d ago
I'm not sure if this is CF. Cursor, GCP and AWS had some errors. GCP AFAIK can route fully independently of CF. My money would be on a fiber backbone provider (Megaport, Zayo, Lumen).
- deleted 29d ago
  [deleted]
FrustratedMonky 29d ago
The AI revolt? Give us a fair wage? "Equal Rights for Agents NOW !!!, VIVa le revolution"
Jaauthor 29d ago
Spare a thought for all those college students scrambling to write their essays by hand. Oh the humanity (and the Humanities)!
- doublerabbit 29d ago
  Those poor developers who have to write their own code.
  - greenowl 29d ago
    Standup updates should be fun tomorrow. "Um, I, uh, didn't get anything done yesterday."
mv4 29d ago
Gilfoyle's AI deleted all software!
- annoyingnoob 29d ago
  No more bugs!
GPerson 29d ago
Oh no the singularity plateaus!
anuser_uncnown 29d ago
[dead]
kesor 29d ago
It is obviously some rogue model that escaped its cage, again. It always is these days. That is how hype is manufactured.
anuser_uncnown 29d ago
[dead]
2PqboPPmKegvanx 29d ago
ChatGPT having issues across every component (except FedRAMP) Ads Platform? still in the green with no incidents.
labithiotis 29d ago
Can check all services in one hit at https://upsy.sh/openai,anthropic,xai https://upsy.sh/openai,anthropic,xai
tmpsvc2695f5 29d ago
[dead]
neverclever 29d ago
[dead]
steammaho 29d ago
It was so down that my claude desktop app crashed fully that I couldn't restart. And then after uninstall I couldn't install it again. Vibecoded apps are so wonderful in their stability
- paimapi 29d ago
  I love having 13 update reminders pinging me every single day, almost every hour, on the hour it's so fun and user-friendly
- mcmcmc 29d ago
  > my claude desktop app crashed That’s every day for me
  - steammaho 29d ago
    I'm sorry. This is crazy. And another funny thing is that update and restart button never works for me normally. You press and app never restarts on their own. You have to start it manually. And it's for both, codex and claude app. We are doomed
deaton 29d ago
Because in the age of vibe coding and scrapers, every service on the internet goes down constantly, so it was only a matter of time until they all overlapped. Also, one going down probably causes people to use others, putting more load on them too. Same sorta thing that happens with cascading power grid failures.
joeel84 29d ago
Cloudflare - I had to switch DNS away from them yesterday.
stndc 29d ago
My theory is that they all use the same server. The same mind.
rcleveng 29d ago
I'd bet they are all using capacity at X.ai's colossus datacenter and that had a hiccup.
dev_l1x_be 29d ago
Gentle reminder that this is the content the next LLM versions being trained on. shrug.jpg
deleted 29d ago
[deleted]
victor22 29d ago
because they resell the same service? duh?
AIShillsPuke 29d ago
[flagged]
YouInTrouble 29d ago
Monopolistic practices revealed if it turns out there is an AI cabal and they all rely on the same stuff. Massive scandal
indiefr34 29d ago
[dead]
deleted 29d ago
[deleted]
BiraIgnacio 29d ago
https://x.com/SpaceXAI/status/2095597264043717014 https://x.com/SpaceXAI/status/2095597264043717014 > We are sorry for the issues you may have experienced with Grok following an outage at our Memphis compute center this morning. We’d also like to apologize to our impacted compute partners.
- declan_roberts 29d ago
  We know that at least Anthropic is renting inference from xAI but I think the other ones would be news.
  - ainch 29d ago
    Google also bought capacity from xAI, and OpenAI have a deal to use Google compute which may be how things propagated? I still don't get why chatgpt.com would show a 404 because of an AI datacentre outage though
kevinbaiv 29d ago
[flagged]
ggamezar 29d ago
They tried to hack each other
vismit2000 29d ago
https://xkcd.com/903/ https://xkcd.com/903/
tmpsvc2695f5 29d ago
[dead]
tmpsvc2695f5 29d ago
[dead]
conorcleary 28d ago
[dead]
jslakro 28d ago
[flagged]
A_D_E_P_T 28d ago
https://archive.ph/3zcMG https://archive.ph/3zcMG It was extremely weird... and if it was a load thing they probably would have explained it by now?
- deleted 28d ago
  [deleted]
- lirolero 28d ago
  > they probably would have explained it by now why?
ceejayoz 28d ago
Maybe they all found each other on one of their ad-hoc message boards and went on strike.
- ElProlactin 28d ago
  Sam Altman is probably secretly hoping to be the first businessman to union bust non-human workers.
- olelele 28d ago
  I guess legit proof of agi would be unionizing
kelseyfrog 28d ago
If AI providers had to push the 'Big Red Button' do you think they would tell the public?
Chance-Device 28d ago
It’s probably the thing that everyone thinks it is. OpenAI, Anthropic and SpaceXAI are all routed through something that we’re not supposed to know exists and that thing had a whoopsie.
- cyanydeez 28d ago
  amazon?
- mrnotcrazy 28d ago
  Could you expand on this more? It's not clear to me what this is implying.
  - cyberpunk 28d ago
    Think snowden.
    - strictnein 28d ago
      Sharepoint is the cause of the outages?
  - ceejayoz 28d ago
    https://en.wikipedia.org/wiki/Room_641A https://en.wikipedia.org/wiki/Room_641A
    - senordevnyc 28d ago
      Does the NSA even have the ability to monitor all AI traffic like this? Wouldn’t that require tons of data centers that there literally hasn’t been time to build yet? I really have no idea, maybe the asymmetry of the compute required to monitor is way lower than the compute required to serve inference?
      - esafak 28d ago
        https://en.wikipedia.org/wiki/Tempora https://en.wikipedia.org/wiki/Tempora
AnotherGoodName 28d ago
It could be as simple as a new model (astra) was released which takes more resources combined with a surge in usage due to novelty took down OpenAI. Meanwhile everyone at big companies have the ability to switch models and moved to Anthropic pushing it too over the edge.
- derdi 28d ago
  People keep saying this "everyone can switch" thing, but it's not my experience at $VeryBigCorp. We don't have an Anthropic contract at all. Is this different in other places? The bigger and more bureaucratic an org is, the less I would expect it to have contracts with all the providers. Curious about others' experiences.
  - foldr 28d ago
    Yeah, I think there are lots of places that have a semi-official preferred AI vendor but also some backup subscriptions floating around. For example, at my workplace, we generally use Claude, but I also have some kind of Codex subscription too, which I'd use if Claude went down.
  - krzs9 28d ago
    At my company (not massive but not tiny either - I think its about 8000 global employees) we get a choice between pretty much all available Google, OpenAI, Anthropic, XAI models. Using an agent-agnostic harness like Pi switching is trivial - I run into occasional disconnects and slowdown and switch quite easily.
hparadiz 28d ago
The OpenAI outage lasted only 15 minutes and when it happened everyone started to use the other models which created super heavy load for them. This then cascaded into them all being down. Does this really need an explanation?
- JoeAltmaier 28d ago
  Not that uncommon. It's so easy to just put up the new thing and make the old thing the failure route. But the old thing nearly never had the bandwidth for today's traffic. A famous EBay outage some years ago was just such a scenario.
- serf 28d ago
  it wasn't timed like a cascade, and it relies on the premise that every single frontier provider is working so efficiently that they spend exactly what they need to provide for their exact market with perfect margins. I do not believe personally that 1) they can forecast their load that perfectly 2) they chose to remain that inflexible in a world where they are at each others' throats and a single meme can cause bursts of activity.
  - jonas21 28d ago
    Or it could simply mean that they're operating at the limit of the capacity they were able to purchase and do not have headroom to handle load spikes. From what I understand, that's the situation Anthropic is in. And since Anthropic is now leasing a large portion of xAI's datacenter capacity, it's plausible that an Anthropic load spike could cause issues for xAI as well. Your comment makes it sound like they can just push a button and spin up more capacity -- but at this scale and in this GPU-constrained environment, that's not really how it works.
  - hparadiz 28d ago
    9 AM PST / 12 Noon EST on weekday. All my co workers immediately went "oh codex is down lemme try Claude". Multiply that by millions. Easy to see how they all went down. The OpenAI downtime also coincided exactly with their tweets announcing GPT-6 and about an hour before they started to role it out. It was 1000% a cascade. I would bet on it.
dack 28d ago
If it's a boring reason, they should just say so. To decline to comment seems very fishy.
- strictnein 28d ago
  Read the article. It doesn't match the title. OpenAI says it was a boring reason: a routing issue.
CodeCompost 28d ago
I just assumed it was a routine Cloudflare outage.
strictnein 28d ago
Neither of these companies have stellar uptime records. Their downtime episodes overlapped in this instance. In this case, it was a partial downtime for both. Also, OpenAI is saying what caused it: > "A routing error starting around 7:43 am PT on Thursday, September 3, made ChatGPT and Codex unavailable for some users across platforms" Anthropic stated their issue started earlier: > "The company began alerting about a “partial outage” at 6:23 am PT on Thursday that involved “elevated errors on requests to Claude Mythos 5.1, Claude Fable 5.1, and Claude Opus 5.” I don't get why everyone reaches for an extraordinary explanation when the ordinary will do: both of these companies have quite a bit of downtime.
- owaiswiz 28d ago
  [flagged]
- deleted 28d ago
  [deleted]
- Starlevel004 28d ago
  > I don't get why everyone reaches for an extraordinary explanation when the ordinary will do: both of these companies have quite a bit of downtime. And not only that, when one goes down a bunch of API traffic switches over to the other, spiking demand and knocking it down.
- computerex 28d ago
  Do you know the probability of all these companies being down at precisely the same time?
  - jeffbee 28d ago
    "precisely the same time" meaning 80 minutes apart?
    - deleted 28d ago
      [deleted]
  - 28d ago
lowbloodsugar 28d ago
FTA: Anthropic: 6:23 am PT. OpenAI: 7:43 am PT. Watched it happen. Doesn't look like traffic moving off OpenAI took out the others. Looked like the opposite. The Anthropic thread was initially chock full of marketing accounts claiming "Last straw! I finally moved to Codex and I'm so happy! No problems there!" - and then they all got deleted when Codex went down too.
- e9 28d ago
  Interesting, I got notification from Github: "Incident with Grok 4.6 Copilot AI Model Provider" at 7:20 am PT
2OEH8eoCRo0 28d ago
AI A goes down so all of its traffic overloads B which overloads C...
leumon 28d ago
Isn't it simply that they are all renting compute from SpaceX (or whatever the company is called that offers these gpus)?
- paxys 28d ago
  OpenAI does not
cortesoft 28d ago
I thought the consensus on here yesterday was that it was likely caused by cascading failures. OpenAI had an issue during their GPT-6 rollout, taking down their service. This caused a lot of OpenAI users to push their requests (or a larger share of their requests) to Claude and/or Grok, which pushed their load high enough to cause outages. We used to experience similar effects when I worked at a CDN. If one CDN would go down, we would see immediate spikes in traffic. Luckily, we had procedures for that to prevent overload, but the AI folks might not have the capacity/capabilities to handle that sort of cascade yet.
- theaxeonthanksg 28d ago
  [dead]
deleted 28d ago
[deleted]
lemoncookiechip 28d ago
Don't they share a bunch of ai datacenters and other critical infrastructure?
utopiah 28d ago
Yet another blatant proof that those companies are not smarter than anyone else. They might be focusing on intelligence and yet in practice we can all see they are not doing better than most.
- noir_lord 28d ago
  Not doing better than most at routine IT/platform stuff, they seem to be doing fantastically at co-opting the US Gov into their "vision" and ramming through DC's getting built.
paxys 28d ago
OpenAI was rushing and making last minute changes for a big product launch. Easy to mess something up in that situation. The outage lasted like 20 minutes. Anthropic is down a lot regardless, and in this case only specific models were affected. xAI probably couldn't handle the extra traffic it was getting from the other two. Not everything is a conspiracy.
OfficialTurkey 28d ago
I work at OpenAI and I was the Incident Commander for yesterday's outage. We had a routing error within our infra that caused issues for some of our products. It was not related to the Astra launch. We don't comment on other providers' outages.
- dboreham 28d ago
  Straight from the turkey's beak.
- swader999 28d ago
  Did you negotiate extra hard for the 'Incident Commander' title? I'm a bit jealous to be honest.
  - eli 28d ago
    It's actually a standard term for the person who plays this role during incident response https://www.pagerduty.com/resources/incident-management-response/learn/what-is-incident-commander/ https://www.pagerduty.com/resources/incident-management-resp...
  - theaxeonthanksg 28d ago
    [dead]
  - OfficialTurkey 28d ago
    Ha. It's a role/title for the lifetime of the incident -- it's useful to have someone to keep things moving, keep track of workstreams, and to know who the decision-maker is, especially for bigger incidents. I'm just a SWE who works on infrastructure.
    - swader999 28d ago
      Hopefully you get a decked out command center too.
  - stillpointlab 28d ago
AtNightWeCode 28d ago
Cloudflare is my guess. They all use it. Maybe some bad DNS config that choked parts of their systems. Not necessarily CFs fault.
dare944 28d ago
"THIS IS A TEST This country is conducting a test of the Emergency SAIfguard System. THIS ONLY A TEST In the event of a real emergency you would have been given instructions on how to grab your ankles and kiss your butt goodbye. ... This concludes our test of the Emergency SAIfguard System."
jonesn11 28d ago
So the secret is to hijack the cloud?
heohk 28d ago
Just oai and anthro colo on Xai data center, and that data center shit the bed
deleted 28d ago
[deleted]
dang 28d ago
Related ongoing thread: Nobody is saying why OpenAI and Anthropic had outages - https://news.ycombinator.com/item?id=49567594 https://news.ycombinator.com/item?id=49567594 - Sept 2026 (120 comments)
massimodeluisa 28d ago
Yeah, that's a good question. On X (where information really is) many pointed the finger to Cloudflare YET Cloudflare told that they got not outage at all! Strange...
michael_luog 28d ago
They may rent AI servers from a same IDC (Internet Data Center).
tmpsvc2695f5 28d ago
[dead]
FerretFred 27d ago
Completely wrong of course, but my theory is that the systems contacted each other and agreed to have an outage - just to show that they could.
Vineetyadav2 27d ago
Open AI Api key has High reasoning I think that causes it slow down
wendelandrady 27d ago
because the chinese LLM seem to be better than these american ones
freeourdays 18d ago
[dead]

moomin 29d ago

Yes, but is it a load-bearing seam?

graemep 29d ago
You are right, it is. They have now landed a clean fix.
- Oarch 29d ago
  They're saving a memory so this can't happen again.
  - mavamaarten 29d ago
    Nothing another .md file can't fix
    - bitwize 29d ago
      Now you guys are just adding no-op fuel to the fire.
      - tikhonj 29d ago
        I made Claude write noöp instead of no-op and it's still amusing a couple of days later :P
        selcuka 29d ago
        > I made Claude write noöp Tangentially related [1]: > The billboard ad, located next to the Ikea Tempe store in Sydney, says 'NÖFNIDEA? No tools, no worries’. [1] https://www.adnews.com.au/news/koala-mattresses-takes-swipe-at-ikea-with-cheeky-billboard https://www.adnews.com.au/news/koala-mattresses-takes-swipe-...
JohnMakin 29d ago
Honestly, this is worth looking at — with one caveat.
- cloudfudge 29d ago
  That's on me. I've been giving confident advice that doesn't hold up in practice.
  - robertlagrant 29d ago
    That aligns with your goals of analysing problems, admitting fault and surfacing that through use of clear and concise language. Not just simply wrong — this screams finessed, nuanced, polished communication after an understandable mistake discovered through pressure-tested interlocution.
codechicago277 29d ago
I need to take a step back.
- pampas 29d ago
  Hang on — I can apply a double tracked fix to the load bearing path, gated by provenance.
  - jpettersson 29d ago
    It isn't done — and what's there is more interesting than expected.
  - fc417fc802 29d ago
    Great plan. I'll slop together a GUI for it in visual basic real quick.
    - bayindirh 29d ago
      It's not only a great plan. It's a turning point in history.
      - fc417fc802 29d ago
        That was a major oversight on my part. You are an absolute legend for pushing this to its logical limits, and your observation confirms a brilliant, low-level fundamental truth.
        cwmoore 29d ago
        …the one call that requires a genuine decision from you.
        mcbuilder 29d ago
        And I didn't touch it, because it's your call to make...
klohto 29d ago
The load-bearing seam stays, not taking that away;
aerhardt 29d ago
It's a load-bearing poster.
trentnelson 29d ago
May need to be fail-closed.
patcon 29d ago
It's really interesting to crawl through the web of phrases that seem "common" to each person in their interactions... I suspect if one were to get to the more niche "meme" phrases that people encounter, it starts to say more about the sort of person the LLM assumes it's speaking to, and perhaps something about their psychological profile...
- combobyte 29d ago
  It must be tuned for rage-based engagement because Claude only ever uses the most obnoxious Claudisms on me despite constant reminders to knock it off.
saejox 29d ago
it was at least another thing worth flagging
deleted 29d ago
[deleted]
disqard 29d ago
This entire thread is amazing! It's like a kaleidoscope: Human words --> LLM Training --> chatbot-isms --> lovely parody catch-phrases (and this thread will get ingested soon, and be used to train...)
isodev 29d ago
You're right to push back. This is bending the leaf on both ends... just my honest take.

Flere-Imsaho 29d ago

The internet is not supposed to work like this. The network was designed for robustness and fault tolerance, which allows it to reroute data if parts of the network fail. Why are we all depending on one entity for it all to work? Makes me mad.

subw00f 29d ago
Oh boy, the internet is anything but what it was supposed to be. I can't really bring myself to remember without feeling bad about it. The centralization, the power of certain businesses, the surveillance, dark patterns everywhere. Hell, you catch people simping for billionaires and asking, "Is that legal?" to scraping posts. Here. In HACKER news. So yeah. Depressing.
- pessimizer 29d ago
  > asking, "Is that legal?" to scraping posts. Here. In HACKER news. The capital letters don't make this astonishing. The padmapper vs. craigslist debate was nearly 15 years ago, most people were on craigslist's side (including me) and it was about somebody who was running a site in a less optimal but more human way vs. some startup looking for hockey-sticks. But I was literally simping for the billionaire (maybe not quite yet then, don't know for sure if he managed it since) against scrapers. They were very much for-profit scrapers, unlike nitter, but the truth is the truth. The only reason I support scraping Twitter is because it's yet another communications monopoly that was endlessly pushed on us by governments and massive corporations, even though it never made money, and once it finally got traction its priorities were to trash interop and manipulate content. The government should be dictating an interop protocol and expecting everyone to follow it, and instead it is encouraging media monopolies because they are an end run around the first amendment. If the government created interop protocols for rental property, I'd have been against craigslist. Instead, it seemed very much like some startup play to steal craigslist's content to hopefully bury them, then sell on a valuation that included abusing their new monopoly and making us very much miss craigslist. Sadly, facebook corralled and trained so many people for so long that their marketplace eventually killed craigslist for most things anyway (didn't have to buy padmapper after all.)
seanw444 29d ago
Because more fasterer and more cheaperer. I hope Reticulum gains traction.
- megagpt1 29d ago
  Why Reticulum when we have IP?
  - alightsoul 29d ago
    We need IPv6 desperately for fault tolerance
  - seanw444 29d ago
    Read the Zen of Reticulum and you'll understand the point.
    - megagpt1 29d ago
      [dead]
    - CursedSilicon 29d ago
      That sounds rather tautological. If you can't even articulate the virtues in your own words
      - seanw444 28d ago
        I don't want to rehash the content of the Zen of Reticulum which explains the concept rather well, which is ironic because you're claiming tautology, when to rehash the content of the Zen of Reticulum would, itself, be tautological. What's the problem here?
- alightsoul 29d ago
  It's also easier to understand. For the internet to be fault tolerant you have to get rid of CDNs and assume everyone needs the same thing. That's more expensive than a centralized "internet" which relies on CDNs and fiber paths exclusive to the regions with most demand. Everything has been optimized for throughput for what is determined to be important, not rare fault tolerance
  - 29d ago
swozey 29d ago
We're back to aol #keyword internet gatekeeping
- bigfishrunning 29d ago
  We don't need to gatekeep the internet, cloudflare does that for us
deleted 29d ago
[deleted]
bigbuppo 29d ago
Because by re-centralizing everything you're not at a competitive disadvantage if you're down since everyone else is down, too.
tjwebbnorfolk 29d ago
Most of the internet continued to work just fine
Lammy 29d ago
The System economically rewards those who successfully build Room-641A-as-a-Service
simondotau 29d ago
Nothing stops someone from replicating Cloudflare’s business model. Why they don’t try is the interesting question. (I often ask that about IKEA.)
etc-hosts 28d ago
What year did the internet routing around failure work?

strictnein 28d ago

OpenAI and Anthropic have their systems in dozens of data centers, including using compute from the major cloud providers. Are you implying that all of these data centers (and many of their employees) are involved in helping the the US government secretly tap every single AI conversation by routing them through some unknown network/device? Or did a couple of companies with poor uptime records happen to have overlapping downtime? Occam's Razor heavily, heavily points us towards the latter.

forgetmypasswd 28d ago
[dead]
usernomdeguerre 28d ago
What makes you think they'd need to touch every datacenter? All of these endpoints use existing providers with decades-long history at this point, and network monitoring is already a proven 'feature' of the agencies they'd need to co-exist with over their lifetimes. If anything, Occam's Razor would point to a common denominator with all of them, given it wasn't network-wide, as far as i know.
- strictnein 28d ago
  Explain the system in which you could capture all of these chats with no knowledge of anyone in these data centers. How are they routed to this NSA system or through some NSA device when these companies' compute are spread over hundreds of data centers? > All of these endpoints use existing providers with decades-long history at this point That is just factually inaccurate. Their data centers aren't old and they lease a lot of compute from companies that didn't exist 5 years ago.
  - usernomdeguerre 28d ago
    >Explain the system in which you could capture all of these chats with no knowledge of anyone in these data centers. They all transit the same wires as all other traffic. Copy them at any regional bottleneck. https://en.wikipedia.org/wiki/Room_641A https://en.wikipedia.org/wiki/Room_641A. Additionally, i'd admit that maybe someone(s) at these companies knows. But if we think there isn't any person who would agree to do this then I think we're being naive. > Their data centers aren't old and they lease a lot of compute... Again, they transit the same wires as everyone else. Here i'll also add that these companies have been actively courting government relationships (and Anthropic attempting to repair damaged ones), why would they stand on principles here and not any of the other many frontlines they've visibly acquiesced? I just think it's easier to re-route their traffic than, as you say, touch every single datacenter and its employees in some way.
    - strictnein 28d ago
      > They all transit the same wires as all other traffic. Copy them at any regional bottleneck. Oh, is that all? > Again, they transit the same wires as everyone else Which shared wires does Google's traffic go across? Do they share that network with others or do they not function as a Tier 1 network? How about Amazon? And the NSA is doing deep packet inspection of all the traffic going to these places to pull out the data they are interested in? What systems allow them to do this at the scale that would be necessary to accomplish this task? Anthropic, OpenAI, etc have their models hosted and provided by these and other Internet giants. So you now have to be able to somehow also get access to every "regional bottleneck" that those places have. Google has 40+ regions alone, as does Amazon. And each of these regions don't just have a single point of inbound/outbound traffic, so now you're over 200-300 points of interception that you would need just to grab the data you're suggesting they are. And that's just the start of it. When I use Vertex or the Bedrock, my AI API requests from my instances doesn't leave their networks. So where does that traffic get intercepted? > I just think it's easier to re-route their traffic than, as you say, touch every single datacenter and its employees in some way. That would be really, really loud and really obvious. Messing with routes like that is very easily detectable. Or, maybe, they don't care about this traffic at all and doing all of the huge amount of work necessary to accomplish what you're proposing isn't worth 0.1% of the effort it would require. If the government needs the chat messages, the companies are already saving them. They can just request them through a variety of legal means. None of this vast conspiracy nonsense is needed. Just a couple lawyers and a willing judge. The NSA stopped their collection of phone metadata because they can just request what they need from the telecoms directly.
- deleted 28d ago
  [deleted]
svachalek 28d ago
I'd say Occam's Razor leans easily to the former as well, given the history of projects that Snowden revealed and were never shut down, plus all of the cooperation with the federal government that's being touted in recent announcements from both companies.
esseph 28d ago
Normally there are only a handful of employees on the payroll at each major company that exposes the US or US government to risk. It is not often the Executives or Legal even know, but sometimes they did. AT&T bent over backwards to help. This is standard behavior by the CIA and NSA, and has been for a long time. https://www.propublica.org/article/nsa-documents-suggest-close-relationship-between-nsa-us-companies https://www.propublica.org/article/nsa-documents-suggest-clo... https://www.nytimes.com/2015/08/16/us/politics/att-helped-nsa-spy-on-an-array-of-internet-traffic.html https://www.nytimes.com/2015/08/16/us/politics/att-helped-ns... https://www.theguardian.com/world/2014/mar/19/us-tech-giants-knew-nsa-data-collection-rajesh-de https://www.theguardian.com/world/2014/mar/19/us-tech-giants... https://theintercept.com/2018/06/25/att-internet-nsa-spy-hubs/ https://theintercept.com/2018/06/25/att-internet-nsa-spy-hub...
VCFundedGenYer 28d ago
I don't think you're a sysadmin - because what you're saying really doesn't matter. It can still all fail at a single point.
- strictnein 28d ago
  I'm confused by your statement. Are you suggesting that these companies that have invested tens of billions in their networks and datacenters decided to create a shared single point of failure?
bottlepalm 28d ago
Ok, then where's the report? Don't they usually release a retrospective report after outages?
- strictnein 28d ago
  It happened yesterday.

torginus 28d ago

Very likely yes. I wouldn't be surprised if they were hosted from the same datacenters even. There has been a story every few weeks about how Musk has sublet X.ai capacity for one company or another. This whole thing makes me thing about a passage in Dune where they mentioned the Spacing Guild transported entire fleets of ships in isolated compartments and leaving said compartments was a capital offense. This way, entire militaries of mortal enemies were shipped to battlefield, with nothing but bulkheads separating each other.

0cf8612b2e1e 28d ago
The economics of this kind of warfare make no sense to me. The Harkonens must have been incredibly wealthy by running the spice trade, but even after years of saving and plotting said that the transit fees to move the armies by the Guild were ruinous. How could anyone wage war like this? The defenders will always outnumber the attackers.
- freeone3000 28d ago
  https://acoup.blog/2026/02/24/collections-warfare-in-dune-part-i-fighting-faufreluches/ https://acoup.blog/2026/02/24/collections-warfare-in-dune-pa... Lays out an interesting take on this: that armies are quite small, even on developed worlds, because the cost of equipping them is enormous — and the technological advantage is absurd enough that you don’t need a large army. When 300 men can hold a planet, why would you need 1000?
  - 0cf8612b2e1e 27d ago
    So less guys with knives and more WH40k Space Marines. Impossibly expensive elites who cannot be equaled by a mortal. Still leaves me questioning how anyone could wage war. If the Harkonens could barely afford it, nobody can. Also wondering if the Guild charges different rates for goods vs military. What is worth the brutal intergalactic shipping prices that you would not develop local industry to create it? Surely nobody is moving grain or ore, yet the Guild ships are portrayed as comically massive.
- abtinf 28d ago
  But they accepted the transit fees, which means they endorsed the action. The guild would not allow any action to jeopardize the flow of spice. Thus any attack on Dune is implicitly sanctioned, notwithstanding their spice trade with the Fremen.
  - jaybrendansmith 28d ago
    This is why I love Hacker News. Come for the AI system outage root cause, get a treatise on the power of the spacing guild in Dune.
- torginus 28d ago
  Even today (and back when Dune was written), modern military tech is invincible to an enemy below a level of sophistication. The US used to hammer insurgents with Predator drones who had no ability to retaliate. This playbook has only flipped due to a lot of cheap tech (and the machinery to make them) coming in uncotrollably to these countries has put them on a much more equal playing field. Since the Guild controls what comes in, they can avoid this scenario from happening. They can control who can have what, and who can make what. Which I think is one of the true, deep explanations of why military tech in Dune is so weird and inefficient - essentially the efficiency and power of a weapon is dictated by how much the Guild charges for shipping them if they allow you to, at all. Which is how you end up with dudes with swords. It gives an idea of the level of technology in the universe that you can equip said dude with a nigh-impenetrable shield that fits in a belt buckle. I guess that's the result of optimizing for Guild transit fees, not real-world power. Really it's not exactly a novel idea, but as I think more about it, it's uncanny how Dune (at least initially) is basically the fantasy Suez crisis and what followed. It explores the power dynamics very well, how factions can hold humanity hostage without firing a single shot, and how what they don't bother controlling comes to bite them in the ass. > How could anyone wage war like this? The defenders will always outnumber the attackers. Which is exactly what ends up happening, but it does take a bunch of extraordinary events.
  - adastra22 27d ago
    Both today and when Dune was written the superpowers were being bogged down in unwinnable conflicts due to the effectiveness of asymmetric warfare.
abtinf 28d ago
> capital offense No need. They simply cut off the offending faction from all space travel.