3 ms·
Multiple engines are down: incident report for OpenAI
- sparc24 4y agoWelcome to the shitshow that is Azure!
- samwillis 4y agoThat incident report is about an issue two days ago, the title of this post (which matches the page) is misleading. They have however also been having issues today, at least with chatGPT, that looked to me to be issues with the web server configuration for their Next.js ChatGPT front end. It seemed to be returning the apps root html file for all requests for JS. All seems fine now though.
- deleted 4y ago[deleted]
- SoftTalker 4y agoWhen chatGPT is down, does it dream?
- bink 4y agoAnd does it dream of pets or cattle?
- brian_herman 4y agoor electric sheep
- reustle 4y agoIf it down so that they can apply some more recent training data, then maybe the answer could be yes.
- sorry_outta_gas 4y agoazure strikes again
- semi-extrinsic 4y ago> Other issues are due to misbehaving bad hardware that need to be identified and removed from operation. > We are actively working on addressing those limitations this quarter. This always boggles the mind, but I've seen similar several times in the past on different HPC clusters. Hardware bugs that you just cannot seem to shake down, that are triggered just often enough to be a problem but seldom enough to be "impossible" to debug.
- ChrisMarshallNY 4y agoThat sounds like almost every dodgy disk drive I've encountered, and those clusters can have hundreds of them.
- nullish_signal 4y agoMaybe someone was Screaming in the Datacenter again, disturbing nearby spinning Disk Drives...
- swader999 4y agoThis was pretty annoying. I had a lot of homework and a science fair due today!
- debarshri 4y agoLooks like openai infra is either kubernetes based or nomad based. Would love to learn how the infra is actually setup.
- deleted 4y ago[deleted]