6 ms·

ChatGPT January 9th Release Notes

71 points by decremental 4y ago

ranting-moth 4y ago
It feels like it's been taken over by the politically correct gang, to the point that its responses are patronizing. "I need a list of very rude words to flag in my chat app". ChatAPT will do it's best to make you feel stupid for asking that. I wish they'd have done that right from that start and it would never had gotten this much popularity.
sixhobbits 4y ago
Maybe they should have gotten Chatgpt to write these release notes. It's really not clear what > Stop generating: Based on your feedback, we've added the ability to stop generating ChatGPT's response means.
- georgeg23 4y ago
  Probably just abort it while it's talking (it generates texts word by word).
- submeta 4y ago
  Once ChatGPT starts generating a response to your prompt, it might take seconds until it finishes. You could not stop it. Now you‘ll be able to.
  - Hedepig 4y ago
    I think they could have worded that better
- watson 4y ago
  When you enter a query ChatGPT will generate a response that slowly scrolls down the screen. I presume they mean to stop that.
- jamesdwilson 4y ago
  not a bad idea. ChatGPT Release Notes (Jan 9, 2021) We are excited to announce the following updates to ChatGPT: Model improvements: We have made several key improvements to the underlying ChatGPT model that will result in better performance across a wide range of topics. Specifically, we have fine-tuned the model to improve its factuality, ensuring that it provides more accurate and reliable responses to user queries. Stop generating: In response to user feedback, we have implemented a new feature that allows users to stop generating ChatGPT's response at any time. ChatGPT Release Notes (Dec 15, 2021) We are excited to announce the following updates to ChatGPT: General performance: Among other improvements, users will notice that ChatGPT is now less likely to refuse to answer questions. Conversation history: We have introduced conversation history functionality, allowing users to view past conversations, rename saved conversations, and delete conversations they no longer wish to keep. This feature is being gradually rolled out to all users. Daily limit: To ensure a high-quality experience for all ChatGPT users, we are experimenting with a daily message cap. Users included in this experiment will be presented with an option to extend their access by providing feedback to ChatGPT. Updated version: Users can confirm they are using the updated version of ChatGPT by looking for "ChatGPT Dec 15 Version" at the bottom of the screen. We hope you enjoy these new updates and welcome your feedback and suggestions for future improvements.
- deleted 4y ago
  [deleted]
boyzman 4y ago
"Stop generating: Based on your feedback, we've added the ability to stop generating ChatGPT's response " Maybe I missing it, but where in the user interface that we can stop the response amid of generating the answer? There is no Stop button or anything on screen to stop it.
- nailer 4y ago
  Can you ask it to stop? That used to not work. Hopefully they fixed it.
- 2dluis 4y ago
  I've tried everything i can think of and can't find how to stop the prompt either
- boyzman 4y ago
  At the time I post this comment, ChatGPT has just been updated with ability to stop response with "Stop Generating" button (shown when generating response).
- 2dluis 4y ago
  Our prayers were answered! I now have the "stop generating" button above the chatbox!!
- albert_e 4y ago
  ChatGPT wrote the release notes and was hallucinating
- OccamsMirror 4y ago
  Must mean the refresh button.
bibelo 4y ago
"Stop generating: Based on your feedback, we've added the ability to stop generating ChatGPT's response" No button, ESC key does not work
- albert_e 4y ago
  Maybe it's just ....hallucinating again.
Thorentis 4y ago
ChatGPT has gotten so much worse since it gained popularity. All the fun and novel things people had discovered it could do are now hamstrung by a rush to censor it, make it politically correct, and try to turn it into a knowledge engine rather than a machine you could chat with.
- submeta 4y ago
  Absolutely! Trying to understand world religions better, it stops very soon once you keep digging deeper. Asking it, why a torture instrument (the cross) became the symbol of Christianity , it tells me that „This content may violate our content policy“
  - mdp2021 4y ago
    > Trying to understand Now meditate about the issues in the idea of trying to understand things that require intelligence through asking the very implementation of unintelligence. (Intelligence is evolving a world model through critical consideration. Unintelligence is acritical disconnected repetition.)
  - mdp2021 4y ago
    ...Furthermore: intelligence is developed (like muscles are developed by moving) by asking oneself questions; exercising creativity and selection in the conception of hypotheses; noting the issues - foundational, satisfactional etc. - in the provisional possible answers found; investigating further to make the candidate ideas more solid or more productive and iterating the process for the inherent branches. Asking an "artificial lunatic" contravenes a few of the implications of the above - starting from the idea of your own exercise.
  - graeber_28927 4y ago
    Tangentially, as a catholic myself, I recently began to find it weird how openly my religion is displaying a medieval torture setup with an obviously tortured, wounded and half-dead man on it, mid-suffering. Not only is it everywhere in churches, but often villages will have big close-to-life-sized, colored statues of him bleeding. And grandmas have it hang all around their house too for everyone to see. Imagine if we replaced every cross statue with some other form of torture that is less symbolic. Say, the scene from saw where he just cut his leg off. Would you object to that scene being displayed as a big ad in your city, or to it being immortalized in your local cemetery as a colored statue? What would your grandma say if you hung posters of that in her living room and her bedroom? I have to admit though, I never found it weird as a child, and I don't think it affected me one bit. Whereas the Spiderman movie spiderbite really upped my phobia of spiders when I saw it at 6. I don't know what to make of all this, I just learned to pause and find all of it weird for a second every once in a while.
awb 4y ago
Do they have plans to update it’s knowledge of current events?
- jacooper 4y ago
  Yes https://openai.com/blog/webgpt/ https://openai.com/blog/webgpt/
  - HarHarVeryFunny 4y ago
    That currently appears to be a different product "WebGPT", rather than a ChatGPT update. There are two ways of giving ChatGPT access to events that post-date the time it's training set was collected. 1) Fine tune (or re-train - but very expensive) on more recent web pages, focusing on ones likely to contain current events, such as news sources. 2) Like WebGPT, train ChatGPT to generate queries for information that can be fed into a variety of external "query response" systems such as web browser, database, mathematica, etc. I guess one difficulty with this second more promising approach, is when would ChatGPT emit it's own naive "sequence of words" response, and when would it emit the response of this indirect query lookup, and/or how would it combine the hopefully factually correct query response into the factualness-unknown word soup it inherently generates. Although this is a more promising approach in terms of having ChatGPT behave they way people want/expect it to, it's a bit ironic in that it really means ChatGPT is itself dumber - it's just being used as a front end for search, essentially "aligned" to emit "what query is most likely to satisfy this sequence of words prompt", so really exposing itself for what it is - a language model that knows about words/language, but not about facts (or reasoning, etc). Of course the real value of some (to be developed) future AI that actually has reasoning capabilities would be to combine multiple sources of data to deduce facts, employ chains of reasoning, and answer novel questions in a logic/fact-based manner.
0x2c8 4y ago
> It should be generally better across a wide range of topics and has improved factuality. Maybe I am being naive, but this is not telling too much as there is no metric attached to it, so the average user cannot (at least immediately) gauge how impactful this improvement is. I think it would be beneficial to have benchmarks for assessing the factuality of large language models. Now, several open questions are: - What is the minimal (necessary) set of questions it must contain? - Can it ever be sufficient? - What is the appropriate metric to use?
- cypress66 4y ago
  It's hard to think of a benchmark for these LLMs that wouldn't be massively overfit (I don't mean via training, but via hyperparameter tweaking).
mckravchyk 4y ago
Anyone noticed that chat history is gone? I was wondering how can they afford to keep all that data, I thought that maybe its peanuts compared to the cost of running the GPT, but well, maybe it's not after all. If the free version will be around for some time, I guess they could create a browser extension to store the responses. Or something as simple as allowing to download the conversation data and load it. Anything would be better than no chat history at all.
- mistercow 4y ago
  Looks like it’s a temporary situation: > Due to high demand on our systems, previous conversations are temporarily unavailable I find it hard to believe that that’s a data volume problem, though. It’s just relatively small snippets of text, and they’re almost certainly keeping the data because keeping the data is one of the main points of the research preview. My guess is that disabling history is a way to mitigate certain user patterns that increase load.
  - replygirl 4y ago
    yes, i do believe "high demand" implies increased load
  - londons_explore 4y ago
    Each of those history items was selectable, and you could continue any of those conversations. To do that, they need to store the model state (to allow continuation). But when they switch out the model, the old model states wouldn't be valid anymore - they need regenerating. Regenerating the model state for a new model uses as much computation as the original conversation did. So, if they want to restore history, they have to do all the compute work they have done in the past, again. Thats gonna be a lot of GPU-hours - Expensive! Another option is they set up another smaller farm of the old model version, and use that for continuing old conversations - but obviously thats some effort to set up, and they'd need to dedicate a set of a few hundred GPU's to running each old version forever. - Expensive! Or yet another option is they show old conversations, but don't allow continuation. That probably just requires a little dev work - and in their position, thats what I'd do. - Worse user experience.
hooande 4y ago
My session dies and I have to refresh the page every few hours. Often I get logged out once per day and I have to complete a CAPTCHA to log back in. The davinci api fails on about every 5th request. ChatGPT will sometimes cut off with an error mid response. My (valuable) chat history is gone. Is anyone else having these problems? I get that the load is high, very heavy usage, etc But I'm starting to feel like they're using that as an excuse. It's been weeks now, and I've paid money for GPT api credits. Scaling is hard. Engineering is hard. I get that. But they need to figure it out. And soon.
- BlueTemplar 4y ago
  They might not be able to if it is too popular (without turning it into a paid service).
- bamboozled 4y ago
  They should ask ChatGPT how to scale their service...
jansan 4y ago
Am I the only one who cannot login due to capacity issues? I wonder if this depends on geolocation.
- collinvandyck76 4y ago
  No, I can't log in either, probably due to everyone rushing to try out the new update. I was given a form to give my email address that they'll notify me at when it's more available.
glandium 4y ago
> improved factuality I assume those release notes apply to when I tried ChatGPT for the first time yesterday. One of my prompts was asking, both in English and in Japanese, who the Japanese Prime Minister was. I made it regenerate an answer 3 times for each. In English, it consistently gave acurate information for the time it said it had data for (2021), albeit formulated slightly differently each time, but every time including the name of the Prime Minister (Suga), the date he started (Sep 16, 2020), his political affiliation (LDP), and that he was Chief Cabinet Secretary under Abe before that. In Japanese, however, it went all over the place. First time, it gave the right name, saying it was current as of August 2021, and that he started on Dec 28, 2021 (not only is the date wrong, it's past the "as of", and funnily enough, Suga was out of office already by then (I had picked that specifically because Japanese Prime Ministers are volatile)). It then went on with a mix of good and wrong information. The second time, it was saying the PM was Mori Yoshiro (who was PM... 22 years ago, but it was still saying "as of 2021"). Third time, it switched to Abe Shinzo, and the fourth time, to Hatoyama Yukio. All former PMs, but it was clearly saying they were current as of 2021. In the last case it was also saying that he had been PM already in 2009-2010 (which is true), implying it was his second time as PM (which is false). What this suggests to me is that it doesn't have any global knowledge, that it can regurgitate in different languages, but that it has some contextualized knowledge where the language is part of the context, but the amount of data it was fed in various languages differ, and the amount of e.g. Japanese context it has might not be enough. Interestingly, though, the way it writes Japanese, where e.g. it adds a subject to sentences where natives wouldn't, does feel like it could be translating from another language. At some point, I informed it that Abe was killed this year, to which it replied that it's not true but that it could be missing information, inviting me to provide more, which I did, after which it assertively told me Abe was very well alive, while still adding that it might have some information missing...
- londons_explore 4y ago
  ChatGPT's training process of ingesting many articles with a context window of a few thousand words means it often can't see the date that an article or bit of text was written. So as far as it's concerned, when learning from an article written in 2006, the prime minister of Japan really is Abe right now. I suspect this could be fixed by having an extra training input of 'date this text was written', and then when generating an output, specify that you want the output to be written as-if the writer is writing it in a specific year.

71 points by decremental 4y ago

It feels like it's been taken over by the politically correct gang, to the point that its responses are patronizing. "I need a list of very rude words to flag in my chat app". ChatAPT will do it's best to make you feel stupid for asking that. I wish they'd have done that right from that start and it would never had gotten this much popularity.

sixhobbits 4y ago

Maybe they should have gotten Chatgpt to write these release notes. It's really not clear what > Stop generating: Based on your feedback, we've added the ability to stop generating ChatGPT's response means.

georgeg23 4y ago
Probably just abort it while it's talking (it generates texts word by word).
submeta 4y ago
Once ChatGPT starts generating a response to your prompt, it might take seconds until it finishes. You could not stop it. Now you‘ll be able to.
- Hedepig 4y ago
  I think they could have worded that better
watson 4y ago
When you enter a query ChatGPT will generate a response that slowly scrolls down the screen. I presume they mean to stop that.
jamesdwilson 4y ago
not a bad idea. ChatGPT Release Notes (Jan 9, 2021) We are excited to announce the following updates to ChatGPT: Model improvements: We have made several key improvements to the underlying ChatGPT model that will result in better performance across a wide range of topics. Specifically, we have fine-tuned the model to improve its factuality, ensuring that it provides more accurate and reliable responses to user queries. Stop generating: In response to user feedback, we have implemented a new feature that allows users to stop generating ChatGPT's response at any time. ChatGPT Release Notes (Dec 15, 2021) We are excited to announce the following updates to ChatGPT: General performance: Among other improvements, users will notice that ChatGPT is now less likely to refuse to answer questions. Conversation history: We have introduced conversation history functionality, allowing users to view past conversations, rename saved conversations, and delete conversations they no longer wish to keep. This feature is being gradually rolled out to all users. Daily limit: To ensure a high-quality experience for all ChatGPT users, we are experimenting with a daily message cap. Users included in this experiment will be presented with an option to extend their access by providing feedback to ChatGPT. Updated version: Users can confirm they are using the updated version of ChatGPT by looking for "ChatGPT Dec 15 Version" at the bottom of the screen. We hope you enjoy these new updates and welcome your feedback and suggestions for future improvements.
deleted 4y ago
[deleted]

boyzman 4y ago

"Stop generating: Based on your feedback, we've added the ability to stop generating ChatGPT's response " Maybe I missing it, but where in the user interface that we can stop the response amid of generating the answer? There is no Stop button or anything on screen to stop it.

nailer 4y ago
Can you ask it to stop? That used to not work. Hopefully they fixed it.
2dluis 4y ago
I've tried everything i can think of and can't find how to stop the prompt either
boyzman 4y ago
At the time I post this comment, ChatGPT has just been updated with ability to stop response with "Stop Generating" button (shown when generating response).
2dluis 4y ago
Our prayers were answered! I now have the "stop generating" button above the chatbox!!
albert_e 4y ago
ChatGPT wrote the release notes and was hallucinating
OccamsMirror 4y ago
Must mean the refresh button.

bibelo 4y ago

"Stop generating: Based on your feedback, we've added the ability to stop generating ChatGPT's response" No button, ESC key does not work

albert_e 4y ago
Maybe it's just ....hallucinating again.

Thorentis 4y ago

ChatGPT has gotten so much worse since it gained popularity. All the fun and novel things people had discovered it could do are now hamstrung by a rush to censor it, make it politically correct, and try to turn it into a knowledge engine rather than a machine you could chat with.

submeta 4y ago
Absolutely! Trying to understand world religions better, it stops very soon once you keep digging deeper. Asking it, why a torture instrument (the cross) became the symbol of Christianity , it tells me that „This content may violate our content policy“
- mdp2021 4y ago
  > Trying to understand Now meditate about the issues in the idea of trying to understand things that require intelligence through asking the very implementation of unintelligence. (Intelligence is evolving a world model through critical consideration. Unintelligence is acritical disconnected repetition.)
- mdp2021 4y ago
  ...Furthermore: intelligence is developed (like muscles are developed by moving) by asking oneself questions; exercising creativity and selection in the conception of hypotheses; noting the issues - foundational, satisfactional etc. - in the provisional possible answers found; investigating further to make the candidate ideas more solid or more productive and iterating the process for the inherent branches. Asking an "artificial lunatic" contravenes a few of the implications of the above - starting from the idea of your own exercise.
- graeber_28927 4y ago
  Tangentially, as a catholic myself, I recently began to find it weird how openly my religion is displaying a medieval torture setup with an obviously tortured, wounded and half-dead man on it, mid-suffering. Not only is it everywhere in churches, but often villages will have big close-to-life-sized, colored statues of him bleeding. And grandmas have it hang all around their house too for everyone to see. Imagine if we replaced every cross statue with some other form of torture that is less symbolic. Say, the scene from saw where he just cut his leg off. Would you object to that scene being displayed as a big ad in your city, or to it being immortalized in your local cemetery as a colored statue? What would your grandma say if you hung posters of that in her living room and her bedroom? I have to admit though, I never found it weird as a child, and I don't think it affected me one bit. Whereas the Spiderman movie spiderbite really upped my phobia of spiders when I saw it at 6. I don't know what to make of all this, I just learned to pause and find all of it weird for a second every once in a while.

awb 4y ago

Do they have plans to update it’s knowledge of current events?

jacooper 4y ago
Yes https://openai.com/blog/webgpt/ https://openai.com/blog/webgpt/
- HarHarVeryFunny 4y ago
  That currently appears to be a different product "WebGPT", rather than a ChatGPT update. There are two ways of giving ChatGPT access to events that post-date the time it's training set was collected. 1) Fine tune (or re-train - but very expensive) on more recent web pages, focusing on ones likely to contain current events, such as news sources. 2) Like WebGPT, train ChatGPT to generate queries for information that can be fed into a variety of external "query response" systems such as web browser, database, mathematica, etc. I guess one difficulty with this second more promising approach, is when would ChatGPT emit it's own naive "sequence of words" response, and when would it emit the response of this indirect query lookup, and/or how would it combine the hopefully factually correct query response into the factualness-unknown word soup it inherently generates. Although this is a more promising approach in terms of having ChatGPT behave they way people want/expect it to, it's a bit ironic in that it really means ChatGPT is itself dumber - it's just being used as a front end for search, essentially "aligned" to emit "what query is most likely to satisfy this sequence of words prompt", so really exposing itself for what it is - a language model that knows about words/language, but not about facts (or reasoning, etc). Of course the real value of some (to be developed) future AI that actually has reasoning capabilities would be to combine multiple sources of data to deduce facts, employ chains of reasoning, and answer novel questions in a logic/fact-based manner.

0x2c8 4y ago

> It should be generally better across a wide range of topics and has improved factuality. Maybe I am being naive, but this is not telling too much as there is no metric attached to it, so the average user cannot (at least immediately) gauge how impactful this improvement is. I think it would be beneficial to have benchmarks for assessing the factuality of large language models. Now, several open questions are: - What is the minimal (necessary) set of questions it must contain? - Can it ever be sufficient? - What is the appropriate metric to use?

cypress66 4y ago
It's hard to think of a benchmark for these LLMs that wouldn't be massively overfit (I don't mean via training, but via hyperparameter tweaking).

mckravchyk 4y ago

Anyone noticed that chat history is gone? I was wondering how can they afford to keep all that data, I thought that maybe its peanuts compared to the cost of running the GPT, but well, maybe it's not after all. If the free version will be around for some time, I guess they could create a browser extension to store the responses. Or something as simple as allowing to download the conversation data and load it. Anything would be better than no chat history at all.

mistercow 4y ago
Looks like it’s a temporary situation: > Due to high demand on our systems, previous conversations are temporarily unavailable I find it hard to believe that that’s a data volume problem, though. It’s just relatively small snippets of text, and they’re almost certainly keeping the data because keeping the data is one of the main points of the research preview. My guess is that disabling history is a way to mitigate certain user patterns that increase load.
- replygirl 4y ago
  yes, i do believe "high demand" implies increased load
- londons_explore 4y ago
  Each of those history items was selectable, and you could continue any of those conversations. To do that, they need to store the model state (to allow continuation). But when they switch out the model, the old model states wouldn't be valid anymore - they need regenerating. Regenerating the model state for a new model uses as much computation as the original conversation did. So, if they want to restore history, they have to do all the compute work they have done in the past, again. Thats gonna be a lot of GPU-hours - Expensive! Another option is they set up another smaller farm of the old model version, and use that for continuing old conversations - but obviously thats some effort to set up, and they'd need to dedicate a set of a few hundred GPU's to running each old version forever. - Expensive! Or yet another option is they show old conversations, but don't allow continuation. That probably just requires a little dev work - and in their position, thats what I'd do. - Worse user experience.

hooande 4y ago

My session dies and I have to refresh the page every few hours. Often I get logged out once per day and I have to complete a CAPTCHA to log back in. The davinci api fails on about every 5th request. ChatGPT will sometimes cut off with an error mid response. My (valuable) chat history is gone. Is anyone else having these problems? I get that the load is high, very heavy usage, etc But I'm starting to feel like they're using that as an excuse. It's been weeks now, and I've paid money for GPT api credits. Scaling is hard. Engineering is hard. I get that. But they need to figure it out. And soon.

BlueTemplar 4y ago
They might not be able to if it is too popular (without turning it into a paid service).
bamboozled 4y ago
They should ask ChatGPT how to scale their service...

jansan 4y ago

Am I the only one who cannot login due to capacity issues? I wonder if this depends on geolocation.

collinvandyck76 4y ago
No, I can't log in either, probably due to everyone rushing to try out the new update. I was given a form to give my email address that they'll notify me at when it's more available.

glandium 4y ago

> improved factuality I assume those release notes apply to when I tried ChatGPT for the first time yesterday. One of my prompts was asking, both in English and in Japanese, who the Japanese Prime Minister was. I made it regenerate an answer 3 times for each. In English, it consistently gave acurate information for the time it said it had data for (2021), albeit formulated slightly differently each time, but every time including the name of the Prime Minister (Suga), the date he started (Sep 16, 2020), his political affiliation (LDP), and that he was Chief Cabinet Secretary under Abe before that. In Japanese, however, it went all over the place. First time, it gave the right name, saying it was current as of August 2021, and that he started on Dec 28, 2021 (not only is the date wrong, it's past the "as of", and funnily enough, Suga was out of office already by then (I had picked that specifically because Japanese Prime Ministers are volatile)). It then went on with a mix of good and wrong information. The second time, it was saying the PM was Mori Yoshiro (who was PM... 22 years ago, but it was still saying "as of 2021"). Third time, it switched to Abe Shinzo, and the fourth time, to Hatoyama Yukio. All former PMs, but it was clearly saying they were current as of 2021. In the last case it was also saying that he had been PM already in 2009-2010 (which is true), implying it was his second time as PM (which is false). What this suggests to me is that it doesn't have any global knowledge, that it can regurgitate in different languages, but that it has some contextualized knowledge where the language is part of the context, but the amount of data it was fed in various languages differ, and the amount of e.g. Japanese context it has might not be enough. Interestingly, though, the way it writes Japanese, where e.g. it adds a subject to sentences where natives wouldn't, does feel like it could be translating from another language. At some point, I informed it that Abe was killed this year, to which it replied that it's not true but that it could be missing information, inviting me to provide more, which I did, after which it assertively told me Abe was very well alive, while still adding that it might have some information missing...

londons_explore 4y ago
ChatGPT's training process of ingesting many articles with a context window of a few thousand words means it often can't see the date that an article or bit of text was written. So as far as it's concerned, when learning from an article written in 2006, the prime minister of Japan really is Abe right now. I suspect this could be fixed by having an extra training input of 'date this text was written', and then when generating an output, specify that you want the output to be written as-if the writer is writing it in a specific year.