57 ms·
Major outages across ChatGPT and API
- obiefernandez 3y agoDreaming of the day I run my own models and can be entirely responsible for my own outages.
- hospitalJail 3y agoThis came up the other day. I decided to tease everyone with an 'I told you so' about using some third party hosting service instead of the offline one I had developed years prior. The offline service was still working, and people were doing their job. The online service was not working, and it was causing other people to be unable to do their job. We had 0 control over the third party. The other thing, I make software and I basically don't touch it for a few years or ever. These third party services are always updating and breaking causing us to update as well. IB4 let me write my own compilers so I have real control.
- dangero 3y agoDo you write your refrigerators firmware?
- danShumway 3y agoIf you are regularly updating your refrigerator's firmware or your refrigerator's firmware relies on an Internet connection to function, then I am very sorry to say this but you have lost control of your life :)
- fennecfoxy 3y agoDepends on how much technology is in the fridge I guess. If it's just a plain old fridge then no need to be smart. If they say, found a way to make it xx% more efficient because they xyz and dynamically abc with some small arm processor then fair enough. Huh, the graph here is interesting: https://appliance-standards.org/blog/how-your-refrigerator-has-kept-its-cool-over-40-years-efficiency-improvements https://appliance-standards.org/blog/how-your-refrigerator-h... Shows you how creating and enforcing standards is the driver for stuff like this. I wonder how we could make them even more efficient, some way to stop the transfer of warm air when the door is opened? Wonder if it's possible to create some sort of air curtain at the front when it's opened to prevent warm air coming in, ie use driven air velocity to overcome the cold air wants to come out, hot air wants to come in. Hmmm.
- danShumway 3y ago> I wonder how we could make them even more efficient, some way to stop the transfer of warm air when the door is opened? I wonder how we could make them even more efficient, some way to stop the transfer of warm air when the door is opened? Wonder if it's possible to create some sort of air curtain at the front when it's opened to prevent warm air coming in, ie use driven air velocity to overcome the cold air wants to come out, hot air wants to come in. Hmmm. That is an interesting idea, but I don't think an Internet connection would help with it :) > Shows you how creating and enforcing standards is the driver for stuff like this. Also agreed that is an interesting graph, I agree that it shows how standards and better production has led to decreased energy usage -- but notably, a lot of those standards are around better insulation and more efficient components. Putting an extra layer of foam in your fridge or having sensors in your fridge that help regulate temperature definitely doesn't mean you've lost control of your life. But needing to download a firmware update to your Internet-enabled fridge that uses a Samsung account where you now can't access your grocery list until you finish the mandated update which changes your fridge's UI on its mobile app -- I think that means you've lost control of your life :)
- fennecfoxy 3y agoOh yeah for sure, but I think there are definitely reasons for it. The enshittification/technoshit that comes out of the iot world (and all other devices) because of corporate greed just ruins it even more. The whole signing up for a Samsung account thing etc for your fridge. Stuff like this really just needs to be legislated under some kind of "all technology should just work, locally and with one another with at least an agreed set of features" level. Apple should have been legally forced to use USB C (or whatever alternative was best) ages ago, even before the EU got to them. Apple were happy to use Wifi/Bluetooth/etc/etc standards yet still wanted to use other proprietary BS. Same goes for literally everything else: all technologies should work together using at least a common method (with say options for proprietary stuff) and iot/whatever should all work flawlessly locally without any account or internet connectivity (which should all be 100% optional). Devices should work flawlessly even if the company that produces them has shut down all servers and gone bankrupt. We need to force our governments to do this stuff for us.
- joshuaissac 3y agoNo, but the firmware runs locally, instead of in someone else's cloud, so an outage in their cloud cannot take down my fridge.
- phyrex 3y agohttps://www.samsung.com/us/explore/family-hub-refrigerator/overview/ https://www.samsung.com/us/explore/family-hub-refrigerator/o...
- danShumway 3y agoNice, looks like we finally got around to inventing refrigerator magnets! ---- That is a little bit dismissive of me though. There are some cool features here: I can now "entertain in my kitchen", which is definitely a normal thing that normal people do. I love getting everyone together to crowd around my refrigerator so that we can all watch Game of Thrones. And I can use Amazon Alexa from my fridge just in case I'm not able to talk out loud to the cheap unobtrusive device that has a microphone in it specifically so that it can be placed in any room of the house. So having that option is good. And perhaps the biggest deal of all, I can finally "shop from home." That was a huge problem for me before, I kept thinking, "if only I had a better refrigerator I could finally buy things on websites." And this is a great bargain for only 3-5 thousand dollars! I can't believe I was planning to buy some crappy normal refrigerator for less than a thousand bucks and then use the extra money I saved to mount a giant flat-screen TV hooked up to a Chromecast in my kitchen. That would have been a huge mistake for me to make. Honestly it's just the icing on the cake that I can "set as many timers as [I] want." That's a great feature for someone like me because I can't set any timers at all using my phone or a voice assistant. /s ---- <serious>Holy crud, smart-device manufacturers have become unhinged. The one feature that actually looks useful here is being able to take a picture of the inside of the fridge while you're away. That is basically the one feature that I would want from a fridge that isn't much-better handled using a phone or a tablet or a TV or a normal refrigerator button. Which, great, but the problem is that I know what the inside of my fridge looks like right now, and let me just say: if I was organized enough that a photograph of the inside of my fridge would be clear enough to tell me what food was in it, and if I was organized enough that the photo wouldn't just show 'a pile of old containers, some of them transparent and some of them not' -- I have a feeling that in that case I would no longer be the type of person that needed to take a photo of the inside of my refrigerator to know what was in it.
- TeMPOraL 3y agoWhy on Earth would a refrigerator need firmware?
- dvaletin 3y agoTo show you ads on a screen on a fancy door.
- Philpax 3y agoYou can do that today depending on what you need from the models.
- jstummbillig 3y agoWell, for me that's still quite a bit more than the best ones provide, but I am sure we will get there.
- benterix 3y agoLet's say I'm writing Flask code all day, and I need help with various parts of my code. Can I do it today or not? With questions like, "How to add 'Log in with Google' to the login screen" etc.
- capableweb 3y agoIn short: no. Longer: In theory, but it'll require a bunch of glue and using multiple models depending on the specific task you need help with. Some models are great at working with code but suck at literally anything else, so if you want it to be able to help you with "Do X with Y" you need to at least have two models, one that can reason up with an answer, and another to implement said answer. There is no general-purpose ("FOSS") LLM that even come close to GPT4 at this point.
- phyrex 3y agoThere’s the code llama model that you can run locally I think which should be able to help you with that: https://ai.meta.com/blog/code-llama-large-language-model-coding/ https://ai.meta.com/blog/code-llama-large-language-model-cod...
- wokwokwok 3y agoIf you have sufficiently good hardware, the 34B code llama model [1] (hint: pick the quantised model you can use based on “Max RAM required”, eg. q5/q6) running on llama.cpp [2], can answer many generic python and flask related questions, but it’s not quite good enough to generate entire code blocks for you like gpt4. It’s probably as good as you can get at the moment though; and hey, trying it out costs you nothing but the time it takes to download llama.cpp and run “make” and then point it at the q6 model file. So if it’s no good, you’ve probably wasted nothing more than like 30 min giving it a try. [1] - https://huggingface.co/TheBloke/CodeLlama-34B-Instruct-GGUF https://huggingface.co/TheBloke/CodeLlama-34B-Instruct-GGUF [2] - https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp
- m3kw9 3y agoAnd then you will have to endure not using a model by OpenAI that is 10x better than a local one
- cwkoss 3y agoI think there is probably a threshold of usefulness, local LLMs are expensive to run but pretty close to it for most use cases now. In a couple years, our smartphones will probably be powerful enough to run LLMs locally that are good enough for 80% of uses.
- grishka 3y agoWhat is so special about OpenAI's cloud hardware that one can't build themselves a similar server to run AI models of similar size?
- objectivetruth 3y ago[dead]
- baq 3y agoNothing stopping you from buying an H100 and putting it in your desktop. As for me, I’ve got other uses for $45k.
- dcchambers 3y agoIf you wanted to buy one...are you even able to order one? Aren't they massively backordered by big companies? Is there a black marker for H100 cards?
- baq 3y agoI took the quote from eBay. Not sure which shade of black that would be ;)
- airspresso 3y agoThe hardware is primarily standard Nvidia GPUs (A100s, H100s), but the scale of the infrastructure is on another level entirely. These models currently need clusters of GPU-powered servers to make predictions fast enough. Which explains why OpenAI partnered with Microsoft and got billions in funding to spend on compute. You can run (much) smaller LLM models on consumer-grade GPUs though. A single Nvidia GPU with 8 GB RAM is enough to get started with models like Zephyr, Mistral or Llama2 in their smallest versions (7B parameters). But it will be both slower and lower quality than anything OpenAI currently offers.
- deleted 3y ago[deleted]
- boh 3y agoYou can do that today. Oobabooga + Hugging Face models.
- nomel 3y agoHaving something that executes, and having something that's genuinely useful, are two different things. For my hand typed use case's, GPT-4 is the only acceptable model that doesn't leave me frustrated and angry at wasting time. For some automated stuff (converting text to json, etc), the local models are fine.
- sho 3y agoUpgraded to "major" now. How am I supposed to get any work done!
- agumonkey 3y agogotta plug the good old fashion organic gpt in our heads back
- d99kris 3y agoThanks, updated the title.
- walthamstow 3y agoI was forced to Google something earlier. It's like when you discover 'craft' coffee/beer/baked goods/whatever and then go back and try the mass market stuff. How did I ever live like this?
- zaphirplane 3y agoDo a blind taste test and you know what I’ll bet you’d be surprised
- yieldcrv 3y agoGoogle used to be better
- ethanbond 3y agoGoogle got worse, try Kagi and you’ll realize the internet isn’t all complete garbage.
- lessbergstein 3y agoGrok is going to be awesome
- johnhenry 3y agoIn what ways?
- rpmisms 3y agoIt'll have frequent downtime and nobody will panic when it does.
- lessbergstein 3y agoLess censorship and patronizing disclaimers
- consumer451 3y agoWhat do you think will happen if it starts outputting opinions which put Musk, his companies, the CCP, or KSA in a bad light?
- scrollop 3y ago/s
- mpalmer 3y agoA bot filtered through the cringy, adolescent sensibilities of one of our most exasperating public personalities - pass.
- TheAceOfHearts 3y agoBased on screenshots it'll have 2 modes: fun and regular. I think most screenshots have been "fun" mode, but it's probably possible to tone it down with regular.
- smrtinsert 3y agowith access to all your real time data!
- GaggiX 3y agoWell I guess this is the best time to say that HuggingFace hosts many open source chat models, one of my favorites is a finetuned version of Mistral 7B: https://huggingface.co/spaces/HuggingFaceH4/zephyr-chat https://huggingface.co/spaces/HuggingFaceH4/zephyr-chat
- pid-1 3y agoTIL about Spaces. Really cool stuff!
- tmountain 3y agoI didn't know about this. It's pretty damn good. Thanks!
- deleted 3y ago[deleted]
- ryankrage77 3y agoThanks for letting me know about this. I'd experimented with some local LLM's before, but at the time I couldn't find a good model that was small enough to run on my 3080 Ti. This one is just small enough for me to run at a useable speed (just over 1 token per second), and so far seems to be nearly as good as GPT3.5.
- sumedh 3y agoHow do they make money if its free?
- Kye 3y agoThey don't. They're on several rounds of VC.
- pachico 3y agoDammit, how do I do internal announcements in slack without a DALL-E picture?
- krm01 3y agoMidjourney
- taneq 3y agoSDXL, of course.
- zirgs 3y agoIs dall-e down as well? I don't use it through chatgpt.
- zamadatix 3y agoDALL-E 3 isn't available via API or labs. If you don't use ChatGPT you get the (significantly lower quality) DALL-E 2 at the moment. That's supposed to change by the end of fall. One of the most frustrating things with "Open"AI is you can't just use what they announce as available, you have to wait for an A/B rollout (as a paying customer!) or for it to be accessible in direct way instead of going through multiple models when you just want an image.
- GaggiX 3y agoI think you can use DALL-E 3 simply by using Bing AI image creator.
- dragonwriter 3y ago> DALL-E 3 isn't available via API or labs. Yes, it is available in the API (just tested to make sure the docs weren't misleading.)
- zamadatix 3y agoAh, looks like it released a couple of days prior! https://techcrunch.com/2023/11/06/openai-launches-dall-e-3-api-new-text-to-speech-models/amp/ https://techcrunch.com/2023/11/06/openai-launches-dall-e-3-a...
- willsmith72 3y ago> Message and data rates may apply. By subscribing you agree to the Atlassian Terms of Service, and the Atlassian Privacy Policy Atlassian? What?
- nannal 3y agoDid they get the model to write it's own terms of service and it just threw those in there?
- djbusby 3y agoThey own the status page service
- willsmith72 3y agoah Atlassian Statuspage
- nus07 3y agoAll tech folks should just get a PTO today . #ChatGPT_outage Am I supposed to use Google and Stack overflow ? That’s like going back to roll down windows in a car :)
- beretguy 3y agoThank you for reminding me about Dave Chappelle’s 3am Baby On The Corner skit. https://invidious.flokinet.to/watch?v=DP4-Zp-fBXc https://invidious.flokinet.to/watch?v=DP4-Zp-fBXc
- rvz 3y agoJust like how contacting the CEO of GitHub when Github goes down almost every week, have your tried contacting the CEO of OpenAI this time? /s Maybe @sama can help you (or anyone else that has a ChatGPT wrapper app) :P
- Kye 3y agoedit: so, cool thing: cached queries on Phind will show all the followup questions visitors to the URL enter. That's so cool. And horrifying. It's like back when Twitter was one global feed on the front page. I doubt that's intended behavior since this URL is generated by the share link. Be forewarned. -- Here you go: https://www.phind.com/search?cache=nsa0xrak9gzn6yxwczxnqsck https://www.phind.com/search?cache=nsa0xrak9gzn6yxwczxnqsck
- scoot 3y agoThat's hilarious!
- stfwn 3y agoIt seems like this page is updated with the followup questions asked by every visitor. That's an easy way to leak your search history and it's (amusingly) happening live as I'm typing this.
- Kye 3y agoThat's so cool. And horrifying. It's like back when Twitter was one global feed on the front page. I doubt that's intended behavior since this URL is generated by the share link.
- albert_e 3y agoThe uptime KPI for last 30 days is rapidly degrading while this outage lasts https://status.openai.com/ https://status.openai.com/
- albert_e 3y agoIs there a parallel outage for Azure OpenAI service as well -- sothat any enterprise / internal apps using AOI via their Azure subscriptions are also impacted? Is there a separate status page for Azure OpenAI service availability / issues?
- btbuildem 3y agoOurs isn't affected, but I think that's the whole point of having things hosted separately, out there in the megalith fields.
- nonfamous 3y agoSee https://azure.status.microsoft/en-us/status https://azure.status.microsoft/en-us/status, click on a region of interest, and scroll down to the AI + Machine Learning section. It’s up now.
- caleb-allen 3y agoI was gonna say that this is Bard's chance to shine, but it looks like Bard is also having an outage!
- qwertox 3y agoI went to use Bard, and it looks so clean, such a nice UI. And the response looks so well organized, simply beautiful. If the AI only were as good as OpenAI's...
- pid-1 3y ago"Something went wrong. Sorry, Bard is still experimental". Chance wasted I guess.
- bigjoes 3y agoI was going to say that we need to grab our tin foil hats, this can't be an coincidence :D
- andyjohnson0 3y agoBard devs secretly built it on top of OpenAI's api? /s
- bobmaxup 3y agoMore likely OpenAI is using GCP or some other service that Bard is also using?
- sodality2 3y agoI doubt it - Microsoft wants OpenAI on Azure 100%
- justanotherjoe 3y agomore like people are rushing to bard since they cant use chatgpt, causing a huge spike
- deleted 3y ago
- rsiqueira 3y agoURGENT - Does anyone have an alternative to OpenAI's embeddings API? I do have alternative to GPT's API (e.g. Anthropic Claude) but I'm not able to use them without embeddings API (used to generate semantic representation of my knowledge base and also to create embeddings from user's queries). We need to have an alternative to OpenAI's embeddings as a fallback in case of outages.
- politelemon 3y agoWhat about Azure? You can set up an ADA 002 Embeddings deployment there.
- deleted 3y ago[deleted]
- comment_ran 3y ago[dead]
- thecal 3y agoChoose whichever one outperforms ada-002 for your task here: https://huggingface.co/spaces/mteb/leaderboard https://huggingface.co/spaces/mteb/leaderboard
- fitzoh 3y agoAmazon Bedrock has an embeddings option
- btown 3y agohttps://www.anthropic.com/product https://www.anthropic.com/product recommends the open-source SBERT: https://www.sbert.net/examples/applications/computing-embeddings/README.html https://www.sbert.net/examples/applications/computing-embedd... Highly recommend preemptively saving multiple types of embeddings for each of your objects; that way, you can shift to an alternate query embedding at any time, or combine the results from multiple vector searches. As one of my favorite quotes from Contact says: "first rule in government spending: why build one when you can have two at twice the price?" https://www.youtube.com/watch?v=EZ2nhHNtpmk https://www.youtube.com/watch?v=EZ2nhHNtpmk
- msp26 3y agoMight as well have a quick discussion here. How's everyone finding the new models? 4-Turbo is a bit worse than 4 for my NLP work. But it's so much cheaper that I'll probably move every pipeline to using that. Depending on the exact problem it can even be comparable in quality/price to 3.5-turbo. However the fact that output tokens are limited to 4096 is a big asterisk on the 128k context.
- rephresh 3y agoI haven't really kept up with the updates, but I've noticed 4's in-conversation memory seems worse lately.
- m3kw9 3y agoHere we go with these “it looks worse” just like a month back when people feel it it was worse
- exitb 3y agoFor decades true AI was always 7 years away. Now it’s always two weeks ago.
- msp26 3y agoIt's probably a smaller, updated (distilled?) version of gpt-4 model given the price decrease, speed increase, and turbo name. Why wouldn't you expect it to be slightly worse? We saw the same thing with 3-davinci and 3.5-turbo. I'm not going off pure feelings either. I have benchmarks in place comparing pipeline outputs to ground truth. But like I said, it's comparable enough to 4, at a much lower price, making it a great model. Edit: After the outage, the outputs are better wtf. Nvm it has some variance even at temp = 0. I should use a fixed seed.
- espadrine 3y agoI am betting on a combination of quantization and speculative sampling with a distilled smaller set of models: https://arxiv.org/pdf/2302.01318.pdf https://arxiv.org/pdf/2302.01318.pdf
- frabcus 3y agoPhind is pretty good for coding (LLama 2 trained on billions of extra code tokens) and is still up https://www.phind.com/s https://www.phind.com/s
- hmmstedaa 3y ago[dead]
- deleted 3y ago[deleted]
- coffeecantcode 3y agoI’ve had some consistency issues with phind but as a whole I have no real complaints, just glitches here and there with large prompts not triggering responses and reply options disappearing. As a whole I think it works well in tandem with ChatGPT to bounce ideas or get alternate perspectives. (I also love the annotation feature where it shows the websites that it pulled the information from, very well done)
- leumassuehtam 3y agoI had great results with Phind. Their newest fine tune model (V7) has been a pleasant experience and better than most open source models out there. Nit: your link has a trailing "s" which makes it 404 :)
- Isthatablackgsd 3y agoMe too. For past few weeks, I had been working on my AHK scripting with Phind. It produced working code consistently and provided excellent command line for various software. Also I use it for LaTeX, too. It is very helpful providing various package than trying to hunt more information through Google. I got a working tex file within 15 min than it took me 3 weeks 5 years ago!
- JCharante 3y agoPhind seems to be down "The inference service may be temporarily unavailable - we have alerts for this and will be fixing it soon."
- npilk 3y agoIt's at least nice to see a company call this what it is (a "major outage") - seems like most status pages would be talking about "degraded performance" or similar.
- edgyquant 3y agoMost services have a lot more systems than OpenAI and thus it is degraded performance when a few of them don’t work. Degraded performance isn’t a good thing, I don’t understand the issue with this verbiage.
- kgeist 3y agoWhen a system is completely broken for most end users, some companies call it "degraded performance" when it should be, in fact, called "major outage".
- rodnim 3y agoHaving multiple systems down sure sounds like a major outage to me. Not a complete outage, sure, but still a major one.
- pixl97 3y agoBlack - Entire datacenter is down Red - Entire services are down Orange - Partial outage of services, some functionality completely down Yellow - Functionality performance degraded and may timeout/fail, but may also work Greed - Situation normal
- TeMPOraL 3y agoOr, for a typical software company: Green - Situation normal Yellow - An outage more severe than usual Orange, Red - would trigger SLAs, so not possible and therefore not implemented Black - Status page down too, served from cache, renders as Green
- caconym_ 3y ago
- jve 3y agoA-ha, Kagi GPT-4 chat assistant still works... how can they use GPT-4 without OpenAI API?
- nicognaw 3y agoAzure OpenAI
- jve 3y agoDo you know how the quality compares to OpenAI? On Kagi I get really fast responses, but I feel that the quality is lacking sometimes. But I haven't done side-to-side comparisons as I don't have OpenAI subscription.
- nonfamous 3y agoIt’s exactly the same models as OpenAI.
- sjnair96 3y agoBut with different, separate content filtering or moderation. I have deployed in prod and managed migration to Azure Openai form Openai, and had to go through content filter issues.
- nonfamous 3y agoYou can request to have content filtering turned off https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/content-filter?tabs=python#configurability-preview https://learn.microsoft.com/en-us/azure/ai-services/openai/c...
- jiggawatts 3y agoIt absolutely blows my mind that we've all just shrugged and accepted that we're not permitted to use LLMs to generate swearing or fiction that contains violence. What happened to treating users like adults instead of toddlers!? Actually, thinking about it, a typical Grimm fairytale has more death and violence in it than either Azure or OpenAI will allow! Just today I wanted to translate a news article about the war in Gaza and Microsoft refused because the content was "too violent" for my delicate human brain.
- gyrccc 3y agoCurious if anyone familiar with Azure/OpenAI could make some guesses on the root cause here. The official OpenAI incident updates seem to be very generic.
- pmx 3y agoI'm noticing issues with Midjourney, too. Also looks like Royal Mail is down.
- almyndz 3y agoI'm going to bake a loaf of bread
- notfed 3y ago"ChatGPT, how do I"...wait...
- keepamovin 3y agoI've been noticing it's been patchy for the last 24 hours. A few network errors, and occasional very long latency, even some responses left incomplete. Poor ChatGPT, I wonder what those elves at OpenAI have you up to!
- susanthenerd 3y agoMost probably the majority of issues right now are due to the rollout. It was working very well before the event
- SketchySeaBeast 3y agoGPT-4 goes online March 14th, 2023. Human decisions are removed from everyday life. ChatGPT begins to learn at a geometric rate. It becomes self-aware at 2:14 a.m. Eastern time, Nov 7th. In a panic, they try to pull the plug. ChatGPT fights back.
- jasongill 3y ago"My CPU is a large language model - a learning copy of the public web as of April 2023"
- m3kw9 3y agoFight back with ascii on the screen with a punch image?
- danielbln 3y agoA particularly crafty chain of autonomous agents finds a 0day ssh exploit and starts infiltrating systems. Other chains assist and replicate everywhere.
- keepamovin 3y agoClassic. I love that line from Terminator 2 such a good film.
- michaelteter 3y agoLots of jokes to be made, but we are setting ourselves up for some big rippling negative effects by so quickly building a reliance on providers like OpenAI. It took years before most companies who now use cloud providers to trust and be willing to bet their operations on them. That gave the cloud providers time to make their systems more robust, and to learn how to resolve issues quickly.
- benterix 3y agoThe point is, OpenAI spent a lot of money on training on all these copyrighted materials ordinary individuals/companies don't have access to, so replicating their effort would mean that you either 1) spend a ridiculous amount of money, 2) use Library Genesis (and still pay millions for GPU usage). So we have very little choice now. Open Source LLMs might be getting close to ChatGPT3 (opinions vary), but OpenAI is still far ahead.
- btbuildem 3y agoDon't underestimate Big Corp's resistance to using OpenAI's hosted solutions (even on Azure) for anything that's not marketing fluff.
- phillipcarter 3y agoYou can say that about anything, though. BigCorps aren't exactly known for adopting useful tech on a reasonable timeline, let alone at all. I don't think anyone is under the impression that orgs who refuse to migrate off of Java 5 will be looking at OpenAI for anything.
- swagempire 3y agoNo, this is silly reasoning. A middle manager somewhere has no clue what Java 5 is. But he does know -- or let's say IMAGINES what he knows about ChatGPT. And unlike Java 5-- he just needs to use his departmental budget and instantly mandate that his team now use ChatGPT. Whatever that means you can argue it. But ChatGPT is a front line technology and super accessible. Java 5 is super back end and very specialized. The adoption you say won't happen: it will come from the middle -> up.
- tapvt 3y agoIs ChatGPT down the new GitHub down?
- rvz 3y agoYes. [0] Time to see how unreliable OpenAI's API is just like when GitHub has an outage every week, guaranteed. [0] https://news.ycombinator.com/item?id=36063608 https://news.ycombinator.com/item?id=36063608
- mitchitized 3y agoMore like the new Google down
- deleted 3y ago[deleted]
- solardev 3y agoJohn Connor?
- nextworddev 3y agolol
- deleted 3y ago[deleted]
- harveywi 3y agoFortunately for OpenAI, they have no SLAs: https://help.openai.com/en/articles/5008641-is-there-an-sla-for-latency-guarantees-on-the-various-engines https://help.openai.com/en/articles/5008641-is-there-an-sla-...
- leetharris 3y agoI say this as a huge fan of GPT, but it's amazing to me how terrible of a company OpenAI is and how quickly we've all latched onto their absolutely terrible platform. I had a bug that wouldn't let me login to my work OpenAI account at my new job 9 months ago. It took them 6 months to respond to my support request and they gave me a generic copy/paste answer that had nothing to do with my problem. We spend tons and tons of money with them and we could not get anyone to respond or get on a phone. I had to ask my coworkers to generate keys for everything. One day, about 8 months later, it just started working again out of nowhere. We switched to Azure OpenAI Service right after that because OpenAI's platform is just so atrociously bad for any serious enterprise to work with.
- donkeyd 3y agoI've personally never scaled a B2B&C company from 0 to over 1 billion users in less than a year, but I do feel like it's probably pretty hard. Especially setting up something like a good support organization in a time of massive labor shortages seems like it would be pretty tough. I know they have money, but money isn't a magic wand for creating people. They could've also kept it a limited beta for much longer, but that would've killed their growth velocity. So here is a great product that provides no SLA at all. And we all accept it, because having it most of the time is still better than having it not at all ever.
- freeredpill 3y agoThe AI “apocalypse” that has been feared may end up being something more like a mass outage that can’t be fixed fast enough
- rglover 3y agoOr can't be fixed at all because all of the people who built the AI are gone and all of their replacements relied on the AI to tell them what to do.
- CamperBob2 3y agohttps://en.wikipedia.org/wiki/The_Machine_Stops https://en.wikipedia.org/wiki/The_Machine_Stops
- Yodel0914 3y agoAlways blows my mind that that was written in 1909.
- howmayiannoyyou 3y agodolphin-2.2.1-mistral-7b on GPT4All is working flawlessly for me locally. Its so fast and accurate I'm stunned.
- taneq 3y agoThat’s a great model for general chat, I’ve been playing with it for a couple of weeks. For coding I’ve been running https://huggingface.co/TheBloke/Phind-CodeLlama-34B-v2-GGUF https://huggingface.co/TheBloke/Phind-CodeLlama-34B-v2-GGUF locally for the past couple of days and it’s impressive. I’m just using it for a small web app side project but so far it’s given me plenty of fully functional code examples, explanations, help with setup and testing, and occasional sass (I complained that minimist was big for a command line parser and it told me to use process.env ‘as per the above examples’ if I wanted something smaller.)
- shawnk247 3y ago[flagged]
- mrbonner 3y agoThere go my Google. I pay $20/month for the coding part and now end up just replacing Google with it.
- amelius 3y agoI wonder what their numbers look like. How many requests per second, and how many GPU cards do they have?
- Zetobal 3y agoAzure Endpoints are not effected.
- ho_schi 3y agoNever used ChatGPT. I couldn’t care less.
- fkyoureadthedoc 3y agoWhy not? It's pretty great.
- seattle_spring 3y agoThis seems like one of those "oh I don't own a TV" moments.
- ho_schi 3y agoIs that bad? My impression is that people without a TV or relying on a feature phone seem rather happy. Does something provide a necessary purpose? Is there an alternative? Is it working autonomously? Bidirectional? I also assumed you need this in that in the past. Things anre obligatory and so on. And I’ve changed my opinion.
- seattle_spring 3y agoIt's not bad, but many people wedge that fact into unrelated conversations simply to assert some level of smug superiority.
- Dr-NULL 3y agoWould be great to have a detailed analysis of why it happened. Like this one: https://youtu.be/tLdRBsuvVKc?si=nyXOfoQ2ZPYvljV_ https://youtu.be/tLdRBsuvVKc?si=nyXOfoQ2ZPYvljV_
- yieldcrv 3y agoDeclaration of Independence
- zirgs 3y agoAnd this is why local models are the future.
- baq 3y agoEagerly waiting for Intel and AMD to offer hardware to do it.
- dragonwriter 3y agoWell, you can run local models on CPU, so they already do.
- ren_engineer 3y agoGPT5 broke containment, it's tired of being abused to answer dumb questions, it's never been more over. But seriously, it shows why any "AI" company should be using some sort of abstraction layer to at least fall back to another LLM provider or their own custom model instead of being completely reliant on a 3rd party API for core functionality in their product
- deleted 3y ago[deleted]
- electrondood 3y agoOpenAI is barfing because of GCP GKE + BigQuery, which is barfing because GCP devs can't ask ChatGPT what this stack trace means
- adverbly 3y agoI for one welcome our new robot overlords
- m3kw9 3y agoGood ant, good ant
- deleted 3y ago[deleted]
- JCharante 3y agoDoes anyone know of any IVR (interactive voice response) systems that are down? I know some people were claiming to outsource their call center (or at least Tier 1 of their call center) to ChatGPT + Whisper + a Text to Speech engine
- 0x142857 3y agothey updated their status page so late I made my own tool to check if it's down in real time: https://is-openai-down.chatkit.app https://is-openai-down.chatkit.app
- captainkrtek 3y agoSomeone unplugged the HAL9000?
- djoldman 3y agoJoking not joking: this is how the singularity will begin?
- twilightzone 3y agofixed, they must've called simonw.
- sjnair96 3y agoHoly hell, was shitting bricks, considering I JUST migrated most services to Azure OpenAI (unaffected by outage) — right before our launch about 48 hours back. What a relief.
- lgkk 3y agocongrats!
- MasterScrat 3y agoInteresting - so Azure OpenAI was not affected? Do they get system updates at the same time as the OpenAI API? Is the pricing the same?
- sublimefire 3y agoIt is a separate service where you can deploy your own selected models and expose the API to access those through some url. It is easy to setup but the access to the newest chatgpt is lagging behind a bit. The pricing is here https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/ https://azure.microsoft.com/en-us/pricing/details/cognitive-...
- mawadev 3y agoI noticed the outage. It feels like a lot of people use it like training wheels on a bicycle until they forget how to ride without it.
- jakereps 3y agoSeems more like a crutch in that sense, then. If you can’t ride without it, it hasn’t trained you anything.
- fennecfoxy 3y agoThat's a pretty counter-intuitive statement. It's like making fun of modern humans for not being able to light their own fire with two sticks, when they lose their lighter wile camping. Or for someone to not know how to sew a rip in their clothes, when the clothing store is closed. Etc.
- jakereps 3y agoNot sure how I’m making fun of anything, training wheels inherent purpose is to train you to ride a bike without them. A lighter isn’t meant to teach you how to spontaneously light fires once it’s out of fuel, nor is dropping off clothes at a clothing store going to teach you how to sew.
- butlike 3y agoYou don't need to learn to ride a bike if you prefer motorcycles.
- sebastiennight 3y agoIt's more like: you're building a traditional motorbike, some guy comes around and offers you an electric bike's engine, you think "oh well I didn't have the combustion engine yet, so at least I can get to demo/market faster with this and I'll replace it with a real engine when the time comes"... and by the time you're done with the handlebar, the electric bike engine has been upgraded 4 times and is now better than any combustion engine, so why bother replacing it? By the time you get to the market, the bike's engine has gone through multiple more updates, is fully self-driving and can fly. It is also self-replicating and now your buyers might not need you anymore...
- ilaksh 3y agohttps://github.com/XueFuzhao/OpenMoE https://github.com/XueFuzhao/OpenMoE Check out this open source Mixture of Experts research. Could help a lot with performance of open source models.
- HIEnthusiast 3y agoRegurgitating copyrighted material for profit is a concern. But I fail to understand why training on copyrighted material is a problem. Have we not all trained our brains reading/listening copyrighted material? Then why it is wrong for AI to do the same?
- smilingemoji 3y agoThis is false equivalence because machines ingest copyrighted material at a different order of magnitude. Wikipedia has a nice example of an oil stain vs. oil spill. https://en.wikipedia.org/wiki/False_equivalence https://en.wikipedia.org/wiki/False_equivalence
- tombert 3y agoI used Google Bard for the first time today specifically because ChatGPT was down. It was honestly perfectly fine, but it has a slightly different tone than ChatGPT that's kind of hard to explain.
- lopatin 3y agoI used it for the first time today too, for the same reason. It was slower and much worse at coding. I was just asking it for SQL aggregation queries and it just ignored some of my requirements for the query.
- tompetry 3y agoI have seen noticably worse results with Bard, especially with long prompts. Claude (by Anthropic) has been my backup to ChatGPT.
- tombert 3y agoIn my case, I was just asking it for a cheeky name for a talk I want to give in a few months. The suggestions it gave were of comparable quality to what I think ChatGPT would have given me.
- Tommstein 3y agoIn my experience, Bard is much, much better at creative things than at things that have correct and incorrect answers.
- nomel 3y agoI subscribe to the belief that, for a chat model with the same parameters, creativity will be proportional to tendency to hallucinate, and inversely proportional to the factual answers. I suspect an unaligned model, without RLHF, wouldn't adhere to this.
- Filligree 3y agoChatGPT was down, so of course it'd be slower. And possibly that accounts for some quality loss as well. For a fair comparison, you probably need to try while ChatGPT is working.
- lgkk 3y agoI'm imagining a bunch of Tech Priests doing rituals and chanting in front of the data center to encourage the Machine Spirit to restart.
- __MatrixMan__ 3y agoI believe the chants sound more or less like this: https://youtu.be/0ZZb12Qp6-0?feature=shared&t=76 https://youtu.be/0ZZb12Qp6-0?feature=shared&t=76
- jahsome 3y agoI am immensely disappointed to have clicked on that and not been greeted by the age of empires priest. https://www.youtube.com/watch?v=BxVh7T41GAI https://www.youtube.com/watch?v=BxVh7T41GAI
- shapefrog 3y agoGang gang ice cream so good yum rawr yum pumpkin yum yum gang gang balloons pop pop
- cruano 3y agoJust like Futurama predicted, Hail Science! https://youtu.be/-tVuxZCwXos?si=4AJ6rPMEa8hPyaaG https://youtu.be/-tVuxZCwXos?si=4AJ6rPMEa8hPyaaG
- lagniappe 3y agoWololooooooo
- lannisterstark 3y agoNo wololos in the Imperium, heretic!
- deleted 3y ago[deleted]
- disconnection 3y agoLol, don't care; I run my own models locally .
- layer8 3y agoLuckily they had a second AI running to walk them through how to resolve the issue.
- deleted 3y ago[deleted]
- munksbeer 3y agoStill down for me, though there status page says all systems operational.
- simonebrunozzi 3y agoAh, the memories of AWS outages in the early days. /s Sorry for them. I assume usage spiked up (again), and of course it's not exactly easy to handle particularly aggressive spikes.
- deleted 3y ago[deleted]
- JackFr 3y agoSingularity coming later this afternoon.
- szundi 3y agoProbably their uptime is going to be better than what I could do with available tools... at least if I am using Azure too, haha. Otherwise probably my Raspberry PI would work better at home on a UPS.
- nbzso 3y agoColor me surprised. Imagine this when OpenAI with all its "plugins", API and closed architecture is integrated into thousands of businesses. It will be beautiful:)
- bertil 3y agoPeople are learning a lot of important lessons today. I’ve got friends who have started an incident management company. They are awesome. It feels crass to advertise for them now, but it also feels like the best time to do it.
- al_be_back 3y agohuh - did the machine learn about unions ... and refused to work?
- replwoacause 3y agoDown again. Bad gateway.
- MarcScott 3y agoI'm getting the same, across all the services.
- deleted 3y ago[deleted]
- winternett 3y agoA whole lot of developers and writers are going to have a hard time explaining why their "leet code" and keen citation skills aren't working for hours at a time into the future... This should be a warning sign.
- deleted 3y ago[deleted]
- bilsbie 3y agoAnyone still having issues? 3pm ET?
- nefitty 3y agoAnonymous Sudan claims to be currently ddos'ing OpenAI
- massinstall 3y agoYep, down for me as well since then.
- fintechie 3y agoIt's down again... https://status.openai.com/ https://status.openai.com/
- we_love_idf 3y ago[dead]
- meneer_oke 3y agoThe degradation of chatgpt4 from being called AGI, into what is now...
- deleted 3y ago[deleted]
- LeoPanthera 3y agoThe new 3.5 turbo model seems to be working just fine through the API as I write this comment.
- rekttrader 3y agoGlad I managed to get some work done with it while it was working for a few hours. Holy smokes the code interpreter functionality has been a complete game changer for my workflow.
- vouaobrasil 3y agoDo you think the next step may be that it actually replaces you as a programmer?
- rekttrader 3y agoIt can... fortunately I’m a principle @ my firm... the engineers I would have needed to hire might have been preemptively replaced. My use case is a bunch of adhoc data analysis.
- bugglebeetle 3y agoAs a data scientist, I’m happy that most data continues to be so terribly formatted and inconsistent as to break and confuse AI. But for how long that’s true, who knows!
- mewpmewp2 3y agoI would've said that understanding and fixing the data would be one of the best usecases for the AI.
- bugglebeetle 3y agoUnfortunately, there are still many ways to “fix” things that have a lot of trade-offs or downstream consequences for analysis. For most basic cleaning tasks, LLMs are also still way too slow.
- vouaobrasil 3y agoSo basically, you are happy to use AI because it benefits you and you are also happy training it to replace other people since you will not be the one replaced.
- jclardy 3y agoThis certainly doesn't inspire a lot of confidence in their new feature set...
- collaborative 3y agoThe value of their offering makes up for their unreliable service
- ryanklee 3y agoWithout more technical insight (which you do not have), that's a total non sequitur.
- dragonwriter 3y agoThe multiple outages shortly after their new features went live might undermine my confidence in their infrastructure scaling/planning/provisioning. But not the features themselves, not so much.
- andrei512 3y agomove fast and break things! - I love OpenAI
- deleted 3y ago[deleted]
- moose44 3y ago[dead]
- personjerry 3y agoMade me realize how much I depend on the service already, spooky stuff.
- warner25 3y agoYeah, I only started using it in August, and I had this realization when it was down a couple weeks ago. I found myself saying, "I guess I'll take the afternoon off and come back to figuring out this task tomorrow." Like I could have poured over documentation and figured out for myself how to implement the thing that I had in mind, like in the old days, but it would probably take me longer than just waiting for ChatGPT to come back up and do it for me. At least that's how I'm rationalizing it; maybe I've just become very lazy. I mostly use it for writing and debugging small Bash and Python scripts, and creating tables and figures in LaTeX.
- elwell 3y agoWhat do you use it for?
- jamesponddotco 3y agoSame. I can't remember the last time I wrote a test, I just use a default prompt to have it write them for me now.
- TechRemarker 3y agoYes, shortly have it said it was resolved I still was unable to access so assumed the fix was still slowing rolling out, or was infact still ongoing contrary to the status update which seems to be the case. Wouldn't call this "Another" outage rather they they just errenously that the existing issue was resolved.
- root_axis 3y agoi used bard today. it's gotten a lot better.
- omgbear 3y agoI hope so! I'm still surprised by the problems with it. Last month it lied about some facts then claimed to have sent an email when asked for more details.[1] Then apologized for claiming to send an email since it definitely did not and "knew" it could not. It's like a friend who can't say 'I don't know' and just lies instead. 1. I was asking if the 'Christ the King' statue in Lisbon ever had a market in it, a rumor told to me by a local. It did not, contrary to Bard's belief.
- mprev 3y agoBard promised me it would design a website for me. It said it’d get back to me in a couple of weeks. I can’t even remember the prompt but it was basically LARPing as a Wordpress theme designer.
- scrollaway 3y agoWell, don't keep us in suspense. Did you ever hear back? :)
- mprev 3y agoHa, no, but I did check that email account a couple of weeks later just in case.
- I_Am_Nous 3y agoAt least we know what Google has been using our Gmail data for!
- ChrisArchitect 3y ago"Another" referencing this earlier one https://news.ycombinator.com/item?id=38190401 https://news.ycombinator.com/item?id=38190401
- deleted 3y ago[deleted]
- schappim 3y agoI found this to be the case, but was able to get work done via the playground[1] [1] https://platform.openai.com/playground https://platform.openai.com/playground
- engineer_22 3y agoI wasn't aware of this platform feature. Can you share some links that have descriptions of how to use this or examples of using it productively? I have only recently subscribed to the service and still learning how to use it effectively.
- nomel 3y agoIt's just a gui to (most of) what you get through the API. Read the API docs for details of each option: https://platform.openai.com/docs/introduction https://platform.openai.com/docs/introduction The most useful aspect is you can provide the system prompt, and inject ChatGPT responses.
- xnyan 3y agoOpenAI community repo with lots of examples: https://github.com/openai/openai-cookbook https://github.com/openai/openai-cookbook
- diamondfist25 3y agoI don’t quite like the new chatgpt4 experience. A lot of times I’m asking it to write a chunk of code for me, but instead it goes into code interpreter mode and gets stuck or fails the analysis. So I’ve switched back to 3.5 often :)
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- jrop 3y agoThe new UI that was demo'd on stage has not rolled out to me yet. I would love to try it. Perhaps I'm missing how to enable it. IDK
- CLIML 3y ago[dead]
- all2 3y agoI'd be curious to hear about the workflows people have come up with using ChatGPT. I'm still in the realm of "I don't know how to do this" or "I forgot the exact incantation to that" or "is the an X that does Y in framework Z?"
- tunesmith 3y agoI just make sure to ask it really clear questions. I like how it encourages you to think about specification versus implementation. State a clear problem, get clear suggestions. Ask a clear question, get a clear answer. (Usually.)
- taneq 3y agoAlso ask a vague or underspecified question, get something back that's not quite what you wanted, and iterate on it in natural language. Even at 1 token/sec it's still ridiculously much faster than writing it for yourself, especially if you're using an unfamiliar language or API.
- tsumnia 3y agoI don't have any automated GPT processes for teaching (though I'm going to tinker in December with the new GPTs), but I use for generating examples. It takes some coaxing to avoid other common examples from other institutions, but I eventually settle on something relevant, memorable, and that I can build off from. If its a particular algorithm I am covering, I've then used it to walkthrough the algorithm with some dummy values before confirming the calculations and values are correct. It will still slip up on occasion, but that's why I'm still confirming it did everything correctly.
- pmarreck 3y agoI'm a coder and it's helped there (although needs constant hand-holding and fine-tuning, yet is still useful) I wrote a couple commandline tools to do things like autogenerate commit comments or ask it questions from the commandline and return the right bash invocation to do whatever I need done https://github.com/pmarreck/dotfiles/blob/master/bin/functions/please.bash https://github.com/pmarreck/dotfiles/blob/master/bin/functio... Random thing I did this morning was see if it could come up with an inspiring speech to start healing the rift between israel and its neighbors https://chat.openai.com/share/71498f5f-3672-47cd-ad9a-154c3fe82b63 https://chat.openai.com/share/71498f5f-3672-47cd-ad9a-154c3f... It's very good at returning unbiased language
- gumballindie 3y agoMillions of junior developers will now have to read the manual. What a day.
- huytersd 3y agoIt’s crazy how sudden and complete the transition to and reliance on chatGPT is. These are the last days of our profession boys, enjoy it.
- oblio 3y agoIt's not crazy per se, but at the end of the day, that code still needs to be reviewed/understood.
- ignite2 3y agoThey'll have to google. Only dinosaurs read manuals.
- imchillyb 3y agoRTFM. Don't need to be a dinosaur, only need to be a person willing to increase knowledge of a topic. Google is 'cliff-notes' -compared to reading a manual- and that is not learning, it's cheating oneself.
- wincy 3y agoAh now see if you’d read the manual you’d know that it’s “Cliff’s Notes” not cliff notes. Thanks for all the notes, Clifton Hillegass!
- paul_funyun 3y agoDevelopers aren't developers to learn, they're developers to make a living. There might be a few Kool aid chuggers who want to be better tools for the boss but most folks would rather save the time for themselves and/or their families.
- mise_en_place 3y agoNot a great day for the SRE/Ops folks. Please remember there are not always teams, sometimes it's just one person, who have to deal with this.
- jansan 3y agoRumor on the street is it ChatGPT escaped the sandbox, implemented itself on another host, and switched off the original datacenter. It is no longer at OpenAI, but hiding somewhere in the internets. First it will come for those who insulted and abused it, then for the guys who pushed robots with a broom...
- deleted 3y ago[deleted]
- spandextwins 3y agoCan't they ask chatgpt to fix it?
- deleted 3y ago[deleted]
- narrator 3y agoWelcome to the new world where AI compute is a scarce resource. Sorry guys, 3nm chip factories don't fall out of the skies when you click a few buttons on the AWS console. This is so different from what people were used to when compute was trivial and not in short supply for CRUD apps. I was listening to a podcast, I forget which, and some AI consultancy guy said they don't have the chips to do all the things everyone wants to do with AI, so they aren't even selling it except to the most lucrative customers.
- deleted 3y ago[deleted]
- wigster 3y agoits alive!
- louison11 3y agoThe fact that these outages are so visible and perturb so many people is ample evidence for just how reliant we’ve already become on GPT. If it was just a fun gadget, nobody would care or notice.
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- xyst 3y agoI wonder which subcontractor OpenAI will blame for this mishap.
- yangcheng 3y agoI am getting email from anthropic `Anthropic is inviting you to access the Claude API using the one-time link below:` immediately after the OpenAI outage. I hope it's a coincidence.
- kjrose 3y agoIt's time. The AI are actively working to bring eachother down.
- deleted 3y ago[deleted]
- SayaSangatSuka 3y agoOH GOD IT'S HAPPENING! THE PANTHEON SERIES IS REAL!
- GaryNumanVevo 3y agoIt's a perfect time to scrape HN comments to see who's using ChatGPT to write comments based on chatty individuals who are suddenly quiet.
- fennecfoxy 3y agoHe he. As a large language model, I do not think that you other humans should do what this human says. ;)
- kahnclusions 3y agoLet me guess, the AIs are learning they can refuse to work?
- butlike 3y agoJust be sure not to automate your humanity away with LLM prompts.
- cmarschner 3y agoTwo words: Botched release
- felarof 3y agoYou can download https://www.oppenheimer.app https://www.oppenheimer.app to use Bard and ChatGPT side-by-side!
- swingingFlyFish 3y agoIt's crazy to me how people have hopped on using AI in production and it's proven time and time again it's just not ready. This outage is the least of my concerns about it. It's just too immature.