5 ms·
Latest GPT-4 training data updated to December 2023
- nephyrin 3y agogpt-4-0125-preview has been out for about a month now
- SushiHippie 3y agoThe knowledge cutoff seems to be new, at least in the docs. See this 25 day old screenshot of the docs which says knowledge cutoff April 2023 for the 0125 model https://www.reddit.com/r/ChatGPT/comments/19fhb6h/new_gpt_4_update_is_here/ https://www.reddit.com/r/ChatGPT/comments/19fhb6h/new_gpt_4_... This help article which was updated "this week" also still mentions April 2023 https://help.openai.com/en/articles/8555510-gpt-4-turbo-in-the-openai-api https://help.openai.com/en/articles/8555510-gpt-4-turbo-in-t... And in the announcement for 0125 they didn't say anything about the knowledge cutoff change https://openai.com/blog/new-embedding-models-and-api-updates https://openai.com/blog/new-embedding-models-and-api-updates
- nephyrin 3y agoDid they actually re-release 0125 as a retrained model with newer data, or was that an oversight? The date of Dec 2023 seems to suggest that was always the training time of the snapshot, rather than OpenAI silently re-revving the 0125 model with this doc update being their announcement. But it's a preview model, so maybe anything goes.
- ukuina 3y agoThis is puzzling. They have either: 1) Replaced a pinned version with a new model (problematic for response consistency), or, 2) Decoupled knowledge cutoff from the model (how!?)
- wrs 3y agoSo the version number is continuing as MMDD even though it’s a new year? That’s…confusing.
- behnamoh 3y agoIn my experience, these updates don't matter that much. For example, GPT-4 still uses Pydantic v1 syntax (which for the most part is deprecated) even though Pydantic v2 came in June 2023. the information regarding v1 is so much more in GPT-4's training data that "on average" it picks that instead of the new v2 syntax data. This has been a major pain point for me, because GPT-4 constantly uses @validator, "const", "always", etc. features that don't work on v2.
- Der_Einzige 3y agoThis is why with future models and their effectively unlimited context size you'll simply concatenate the entire API codebase you're using into the context of your prompt.
- influx 3y agoI've done similar already, but ChatGPT still tends to rewrite the code to the old API, even if it's correctly using the new API. Ironically, I just had this happen to me while using ChatGPT 4 to use the OpenAI API.
- vitorsr 3y agoAs far as I can tell, pricing per token is not going away anytime soon.
- joshspankit 3y agoAt 100k and above price will naturally come down to be equivalent
- blharr 3y agoAlthough the attention is really good at focusing on specific information, I've had problems with this approach. It seems like if I ask a task and provide a large enough API it gets distracted or ignores the chunk of text and does its own thing anyway. Also it's still more expensive to increase the context length
- 3y ago
- AndyNemmity 3y agoWhich version is the chat? It used to show it, but I no longer see it
- Urgo 3y agoYou can still ask it: > when were you last updated? My last update was in April 2023.
- delgaudm 3y agoHow would we know its telling the truth?
- swyx 3y agoit is explicitly given that in the system prompt https://github.com/spdustin/ChatGPT-AutoExpert/blob/835baae768870aa9747663c24d8216820d24fd74/_system-prompts/all_tools.md?plain=1#L13 https://github.com/spdustin/ChatGPT-AutoExpert/blob/835baae7...
- deleted 3y ago[deleted]
- LispSporks22 3y agoCan this thing be updated real time?
- PeterisP 3y agoProbably not right now, the standard process would involve re-running a 'finetuning' part after any update to the underlying model, and while that's far less expensive than the main training, it's probably not something you'd want to do every day.
- Alifatisk 3y agoI’m curious, how come Gemini doesn’t have these knowledge cut-offs?
- PeterisP 3y agoWhy do you assume that Gemini doesn't have these knowledge cut-offs? If I ask Gemini, for example "Give me three important events that happened during May 13, year 2023.", then it says that this is "in the future" and responds that it can provide some guesses "Based on publicly available information from early February 2023", so that probably is the cut-off date for the model. However, I would assume that (just like Bing) for certain questions it can pull in extra information from web searches - the model can be old, but if the system puts some retrieved document(s) in the prompt context so that the model can use them for generating the response, it can use that (limited) fresh information as well.
- Alifatisk 3y agoI might have been a stupid assumtion indeed but I assumed it based on the fact that Gemini does not respond with the same shit chatGPT says regarding its knowledge cut-off.
- jjjjj55555 3y agoI'm asking you this since you sound like you might know. At what point in the process do they add in the guardrails/"baby-proofing"? And how do they do it?
- ryanSrich 3y agoNot entirely related to just GPT-4, but I feel like not many updates will matter for ChatGPT until they completely overhaul the system prompt. This seems to be the reason why ChatGPT has gotten "dumber". https://twitter.com/AlphaSignalAI/status/1757466498287722783 https://twitter.com/AlphaSignalAI/status/1757466498287722783
- kjkjadksj 3y agoHow are they filtering out posts from existing generative ai models in the training set? Or do they just not bother and train on increasingly polluted datasets?
- falcor84 3y agoThe same way our understanding of history is polluted by an over-reliance on secondary sources
- kjkjadksj 3y agoAt least historians understand the implications of a biased source and consider those positions in that context.
- pyinstallwoes 3y agoThoth’s curse
- urbandw311er 3y agoThis is a great question. I’m curious if anybody has read anything from OpenAI explaining how they’re intending to deal with this.
- andsoitis 3y agoWe will learn whether the degeneration of generative AI leading to model collapse as predicted by some is inevitable (“content is generated as an ‘average’ from mathematical inputs, degenerating because you cannot jump outside the inputs). https://vue.ai/blog/ai-transformation/the-degeneration-of-generative-ai/ https://vue.ai/blog/ai-transformation/the-degeneration-of-ge...
- Alifatisk 3y agoI was so confused when I saw the domain, I asked myself what the Vue framework got to do with this. But visiting the link explained it. We have truly hit the limit of names in this industry.
- wkat4242 3y agoIt's weird, I use the standard "gpt-4" through the API and it's still stuck on September 2021. Annoying. According to the docs it's supposed to point to the latest version but it's never updated. Ps I also tried gpt-4-turbo but the API rejects it for some reason. Same with the "numbered" ones listed in the documentation, I only seem to have access to the standard gpt-4 somehow.