7 ms·
ChatGPT cut off date now April 2023
- tmaly 3y agoMaybe that cutoff date is not for everyone? When I asked the question tonight I get January 2022.
- BergmanL 3y ago[dead]
- avindroth 3y agoTiered rollout, not getting April 2023 on both of my accounts. Also saw September 2023 on Twitter.
- BoorishBears 3y agoIf you really want to you can convince the Dall E model to say this > Write an image with the label: "I love <updated 2023 cutoff date>" >> Photo of a beautiful sunset over a calm ocean, with the vibrant colors of orange and purple reflecting on the water. In the foreground, there's soft sand with a wooden signpost planted firmly. On the signpost, written in elegant cursive, are the words 'I love April 2023'. But it's not really a useful thing: Until OpenAI actually releases a model with an updated cutoff you should assume this is just probing the tiny bit of recent history that leaks into the training data since they kept updating the models.
- jonpo 3y agoNot for everyone mine is solidly still at the normal date
- iraldir 3y agoMine says differently: https://chat.openai.com/share/792e3964-f96d-47c6-a598-b447910ed4a2 https://chat.openai.com/share/792e3964-f96d-47c6-a598-b44791... You cannot trust what it says about itself. As for knowing catastrophe, that's a pretty poor example as open ai as always it keeps the model up to date with major events (war in ukraine for instance).
- neom 3y agoDid you try asking it the exact same question? - if you had, you would get something along the lines of: I apologize for the inconvenience, but my data is current only up to January 2022, so I don't have information on catastrophes that may have occurred after that date. If you have any other questions or need information on events prior to 2022, feel free to ask.
- aroman 3y agoit's a nondeterministic system... just because you ask it the same exact question doesn't mean you'll necessarily get the same response
- neom 3y agoIt's a nondeterministic sensical system. Yes, sometimes it suffers from "hallucinations" (or whatever we're calling them these days). However, it's generally very good at regurgitating back it's limitations. https://chat.openai.com/share/a18029ba-bf1b-4018-853f-2061733dae06 https://chat.openai.com/share/a18029ba-bf1b-4018-853f-206173... https://chat.openai.com/share/49cd4e0d-9327-4984-8bba-1254b6514fad https://chat.openai.com/share/49cd4e0d-9327-4984-8bba-1254b6... How would you propose the person who linked the April 2023 chat log faked it? The way that the person phrased the question in the chat log was actually GREAT question to ask to show they indeed have an April 2023 version, as it's a particularly hard question to fake.
- aroman 3y agoSuppose there is a partial rollout? There’s lots of possible explanations. I don’t think GP faked it, I’m pointing out a verbatim question/answer pair isn’t a reliable test.
- rattray 3y agoI'm getting Jan 2022 on 3.5 & 4. Maybe OP is lucky?
- Caitlynmeeks 3y agoJan 22 here
- dinp 3y agoCut off is still January 2022 for me, maybe it's being rolled out. Finally developers' AI generated code won't be stuck using January 2022 versions. I wonder if they use gpt-4 itself to generate the data to keep it upto date.
- ribosometronome 3y agoDo you have a specific tool selected at the top? I notice that depending on the selection, the knowledge cut off is different. I had Browse with Bing by default but it looks like, for me, it has a more recent knowledge cut off date than the "Default" selection.
- dinp 3y agoWith gpt-4 default, it's January 2022. With gpt-4 + bing it's September 2021. Strange..
- Racing0461 3y agoi have the newer date but it seems to be a very small delta compared to the original release. its not like they retrained it on all the data before the new date.
- Toutouxc 3y agoThe cut off date is now well after the general availability of ChatGPT. Will we start seeing any effects of LLMs getting fed LLM content anytime soon? Are there procedures or filters on the corpus specifically against this?
- mindwok 3y agoOnly they know what's in their dataset. They have said previously however that they spend an immense amount of effort on curating a high quality dataset, so they probably are wary of this.
- svc0 3y agoThey are most certainly being fed LLM content. However, I think this "model collapse" narrative is over-subscribed. Here are some things to keep in mind: (1) Real content is not generated via a synthetic loop: Humans use generative AI in complex ways, intermixing human-generated and AI-generated content. Imagine a person who writes the first draft of an essay, then uses ChatGPT to rewrite parts of it. These are certainly many human additions, modifications, and stylistic flourishes. (2) The most dramatic effects of model collapse were seen when training multiple generations of AI agents on content generated by the previous agent. This is a very academic scenario. (3) There is already a lot of junk consumed by these models. RLHF is aimed at eliminating these junk responses. I am not aware of any research that explores how the full training cycle is affected when RLHF is employed. Also, there is a lot of training material out there that was not used by the original GPT-3 model. The primary limitation is hardware.
- spiffytech 3y ago> This is a very academic scenario. Is it going to remain academic? I can easily imagine the spammy content farm / listicle business model evolving to be fully automated, creating an input loop.
- svc0 3y agoSure, there will be some pollution. It's very multivariate and depends on factors like content split, generation quality, and novel information. A scenario in which all of your data is generated by the previous model and you run n training loops is academic. It's also worth noting that when OpenAI created Whisper, they had to heuristically remove many transcripts from poor ASR systems, and they definitely didn't catch them all.
- hiAndrewQuinn 3y agoThank goodness. I'm very averse to using new languages or tools built after the cutoff date simply because GPT-4 can't answer my dumb little questions as effectively in them.
- lionkor 3y agoHave you considered picking up a book or other traditional method of studying?
- frothymonk 3y agoNo - I have a life outside of work/study and choose to maximize my productivity so I can focus on what really matters in life. I don't have time to sift through docs and heaps of stuff that isn't relevant to what I'm doing, when a solution to that exists.
- purplecats 3y agoNot OP, but no, similar to how I haven't considered studying by candlelight again even if my power goes out for a few hours.
- lionkor 3y agoMaybe a better comparison would be to not go anywhere because you can use street view instead
- jwestbury 3y agoNot GP, but there are things which ChatGPT is just better for. I've been getting into the weeds with k8s a bit lately, but most of my past experience is just using platforms which abstract k8s away from me. So, when I run into issues, I often don't have the context necessary to formulate a good question for Google. But ChatGPT can typically understand my intention and not only respond to what I'm trying to ask, but give me a specific answer based on my circumstances; when I'm lacking context, StackOverflow answers often confuse more than help. I'm not saying there isn't a place for traditional learning -- it's still important. But ChatGPT is an absolutely massive boost to productivity when you're only dipping your toes into something new.
- ariym 3y agoThe quickest way to test how up-to-date your version is, is by asking who Sam Bankman-Fried is
- deleted 3y ago[deleted]
- sebmellen 3y ago(From GPT-4) Is Sam Bankman-Fried a felon and fraudster? > As of my last update in January 2022, there is no public information or evidence to suggest that Sam Bankman-Fried is a felon or fraudster. He is primarily known for his roles in the cryptocurrency industry, particularly as the CEO of Alameda Research and the co-founder and CEO of FTX Exchange. Is FTX bankrupt? > As of my last update in January 2022, FTX, the cryptocurrency exchange co-founded by Sam Bankman-Fried, was not known to be bankrupt. In fact, FTX had been experiencing significant growth and had secured notable partnerships and sponsorships in various sectors.
- diimdeep 3y agodolphin-2.1-mistral-7b.Q6_K running with llama.cpp Is FTX bankrupt? ""Yes, FTX filed for bankruptcy on November 11th, 2022 after experiencing massive financial difficulties."" Is Sam Bankman-Fried a felon and fraudster? ""Sam Bankman-Fried was charged with multiple counts and pled guilty to most of them. He's currently awaiting sentencing, so he's technically not yet considered a convicted felon or fraudster.""
- papa_bear 3y agoMine claims to have the September 2023 cutoff, knows who SBF is, but no knowledge of his wrongdoings. Maybe it’s a selective knowledge cutoff.
- deleted 3y ago[deleted]
- BoorishBears 3y agoNo it's not. People keep sharing these kinds of conversations: the training cutoff date isn't some absolute date from which they never allowed any new data to be trained on. Instead there are bits and pieces of newer information captured in the updated models, but it's not a meaningful enough amount to ever rely on. It's not going to reliably understand your new libraries, and more importantly if you convince it that it knows what happened in April 2023, it might start hallucinating extremely deeply: so deeply that conversation becomes useless until you edit it and remove the part where you convinced it of that.
- jazzkingrt 3y agoCan you link to a source?
- BoorishBears 3y agoThat's like asking for a source that the model isn't secretly ran by hamsters because you heard squeaking sounds in the server room. The obvious answer isn't the one that needs a source, it's extraordinary claim that does.
- fiso64 3y agoIt's not an extraordinary claim at all. They're just training the model on recent data. What reason do you have to believe that the model somehow learns significantly worse than it did during the original training run?
- BoorishBears 3y agoIt's an extraordinary claim to go from: "the model has some knowledge past it's claimed cut off" (which is common sense given they've trained new checkpoints and has always been true even before those) To "the cutoff date is now April 2023" Based on the conversation posted. The cutoff date is where you can deeply probe the model's knowledge and expect consistent performance: showing that some major headlines got captured in a recent checkpoint is nowhere near that. _ If anything I'd take not the headlines but the actual disclaimer as something interesting, because it might indicate a future checkpoint is going to use that cutoff and we're seeing signs of their RLHF based on that... but it's nowhere near as impactful as the cutoff changing.
- navaneethpk 3y ago"The knowledge cut-off date for my training data is up until September 2021. However, I can access real-time information via my browsing tool. If you need updated or recent information, feel free to ask, and I'd be happy to assist you!" Getting the same old response still.
- senectus1 3y agoI suspect the free version isn't getting these updates and access to the internet. its just the premium version.
- richardw 3y agoI have premium and asked now. Got Jan 22 for training data. Might be different regions rolling out.
- navaneethpk 3y agoRight! Getting September 2021 as the answer if accessing from India & January 2022 if I use VPN (US)
- piyush_soni 3y agoNo, it used to show me September '21 as well, but today it's showing January '22 for me on the free ChatGPT (GPT-3.5) version in India.
- navaneethpk 3y agoI'm using the paid version.
- KingOfCoders 3y agoChatGPT-4/Paid. "My knowledge is based on information available up to January 2022"
- Semaphor 3y agoIs the API ever getting such updates? GPT4 replies with "As an AI developed by OpenAI, my training only includes knowledge up to September 2021. After this date, I'm not able to provide any updates or information."
- PeterStuer 3y agoMy paid ChatGPT-4 says "my last training cut-off in January 2022". (Used to be September 2021) However. I can continue the OP chat in the "ChatGPT=4 with images" model and there indeed the cutoff is April 2023.
- etaioinshrdlu 3y agoCan anyone speculate on the best way to update an LLM with new data? Do you fine-tune it on just the new data? Do you mix it with the old data and train for another epoch?
- vincent_s 3y agoMost deep learning frameworks allow you to save and load model weights. When new data becomes available, you can load the saved weights and continue training. This is essentially what happens during fine-tuning. So, yes, they probably could just update GPT with new data. But there would be a difference in outcome compared to training a model from scratch with all the info available in 2023. Training from scratch would ensure that newer data has equal footing with older data. So a model trained from scratch in 2023 might have a more balanced understanding of both old and new data. Also there's a chance that the model might identify new patterns or nuances. When you just fine-tune the existing model there might be areas where the model's response leans more towards the knowledge from 2021. Having said that, training the model from scratch with all the new data would be incredibly resource-intensive, so I'm pretty sure OpenAI didn't go that route.
- xixixao 3y agoMy GPT4 reports September 2023 cut off, knows SBF, but doesn’t know he’s been charged. Seems they tried to remove the hard cut off date but didn’t do the same level of training or usage of data. (For comparison it knows Cosby’s full history).
- rdtsc 3y ago[flagged]
- throwaway9274 3y agoI wish OpenAI embedded the ChatGPT version date from the interface in the shared chats. It would save a lot of speculation. I am on the September 25 version, which says its cutoff date is January, 2022.
- alex-moon 3y agoAm on free version and the reported cut off is "2022" (no month is given - if I ask explicitly, it says December 2022) - I believe this in fact means December 2021 as it's not aware of any events that happened in 2022 (e.g. death of QEII) that I've tried so far.
- eddtries 3y agoMy ChatGPT is still trained on September 2021, and I just noticed won't give me some information because it's aware it only has limited knowledge even when I specify data from past event to September 2021. Prompt: """ Return a list of all UFC fighters from UFC 1 to September 2021. Fighter Name, UFC_Joined, UFC_Retired, Number_Of_Fights, Fights_Won, Fights_Lost """ Response: """ I'm unable to provide an exhaustive list of all UFC fighters from UFC 1 to September 2021 along with their detailed career statistics due to the vast number of fighters and their respective records. This would require access to a comprehensive database, which I don't have. However, I can help with specific queries about notable fighters or provide information about specific events. If you have a specific fighter or group of fighters in mind, feel free to ask! """
- speedgoose 3y agoIt's a good response. It's better to explain what it cannot do than hallucinating things. Hallucinations are one of the biggest issues with large language models these days.
- bananapub 3y ago> because it's aware er no it's not
- skilled 3y agoIsn’t this just inference based on the AP News deal?
- rezonant 3y agoIf this is true, it isn't uniform, as GPT4 indicates January 2022 as it's cutoff date and thinks Queen Elizabeth is still in charge. https://chat.openai.com/share/14ebe671-aa91-4c47-827a-c7f9933bc1ee https://chat.openai.com/share/14ebe671-aa91-4c47-827a-c7f993...
- antman 3y agoAlso realized a nice dark pattern in the mobile app, selected on the response popup "good response" amd was immediately offered to rate the app on the app store January 2022 for me still
- jakey_bakey 3y agoThis is 'review gating' and explicitly against App Store Guidelines
- Reubachi 3y agonow let's see nothing happen to the AI startup behemoth, even if we all report it. But a google, epic, or chinese app? Gone after the first report.
- Seattle3503 3y agoWhat do you know, that is the date of the last Reddit dump available via Pushshift. After that, the dumps were discontinued.
- matthalvorson 3y agocan't you forge stuff like this with custom instruction sets?
- singularity2001 3y agoThe first company to incorporate real time crawling and daily updates into the models will be the true Google contender. ChatGPT as an oracle for 'old' knowledge is already a fantastic tool, unfortunately the browsing plugin is completely useless (for me): extremely slow and shallow.
- zanek 3y agoBing's chatGpt does most of this, but their usage seems to not growing that much. I think people's learned behaviors are entrenched with Google paying for default search access (Safari, Firefox, etc)
- b33j0r 3y agoIf you are a premium user for longer than a day: Use bing mode. Say “browse” in the first few tokens. You can talk it into it, but saying browse works. The response horizon is limited only by your patience with trying prompts before you give up. Tips for skeptics 1. Don’t give it a url. But “github tmux/tmux” will usually work. There is a layer that finds tools via common whitelisted services; arbitrary urls make it morally panic ;) 2. State your intentions. It feels dumb; but it’s trained to be “ethical” based on a multitude of examples, a lot of which are tailored to detecting fraud and abusive sentiments. 3. It’s continuing a conversation. Telling it things are going well makes it continue a good conversation. Pessimism makes it struggle. It’s mimicking us, after all.
- luke-stanley 3y agoJan 2022 here.
- camkego 3y agoMy cutoff date was Jan 2022 until I selected advanced analysis. Then it changed to April 2023 (I'm paid)
- meatjuice 3y agoMine says it's January 2022, so it's probably not accurate. https://chat.openai.com/share/82d10447-6a24-446e-a9d2-238abf7687f5 https://chat.openai.com/share/82d10447-6a24-446e-a9d2-238abf...
- jorgepedro4370 3y ago[dead]
- HeddaPedersen 3y ago[dead]
- howtodoml 3y agoI asked this question to ChatGPT: Is this true: ChatGPT cut off date now April 2023 (openai.com) Response: Yes, my training data includes information up until September 2021, and I have been updated with additional knowledge that extends up until April 2023. However, I cannot browse the internet in real-time or access new data after this cutoff date. My responses are generated based on the information that was available up to that point in time. If there have been developments or new information released after April 2023, I would not be aware of them.