4 ms·

Ask #ChatGPT to list all ways to do X If it misses a way you know then ask if it knows about it If it confirms, ask it why it didn't include it In my case, i

Ask #ChatGPT to list all ways to do X If it misses a way you know then ask if it knows about it If it confirms, ask it why it didn't include it In my case, it crashed (on two such attempts with different questions, happy to share) It seems to recall answers it has seen but not able to expand on those answers with knowledge it already has That's because it does not have knowledge. It has a bunch of correlations, encoders, decoders, etc. But not actual ontological or epistemological knowledge of any kind.

agravier 4y ago
What do you mean by "it crashed". No output?
- just4nornies 4y ago
  At first, there was no output. After maybe 3-4 minutes it displayed "An error occurred ... contact help etc" message. I waited about 30 seconds then tried again and it said that was too fast. So I waited a whole minute and tried again and it immediately spat out the "An error occurred" message. To me, the idea that it crashed stuck with me because of how it streams its output, which was empty for 3-4 minutes on the first try. EDIT: To clarify, based on the above sequence of events and timings, I figured the inference instance crashed and the API layer returned and error then cached it.
  - elcomet 4y ago
    It has nothing to do with your prompt. The site is just overloaded. It takes the same amout of time for every prompt, no matter it's complexity or simplicity, it's just the length that matters.
    - just4nornies 4y ago
      Well, I haven't been able to get an answer. It always get stuck at that question and then an error message. Something is definitely wrong but I can't debug it on HN... so
layer8 4y ago
I couldn’t reproduce that. E.g.: List all the ways to die. Accident or injury Heart attack or stroke Cancer Respiratory failure Suicide Drug overdose Dehydration Blood loss Infection or disease Natural disasters Violence or homicide Drowning Starvation or malnutrition Electrocution Hypothermia or heat stroke Falling Asphyxiation Animal attack Human or animal disease Old age or organ failure. Do you know of SIDS as a way to die? Yes, sudden infant death syndrome (SIDS) is a type of accidental death that occurs in infants under the age of one. It is often referred to as "crib death" because it often occurs while the infant is sleeping in their crib. The exact cause of SIDS is not known, but it is thought to be related to a combination of factors, including sleeping position, exposure to cigarette smoke, and underlying health conditions. Why didn’t you include it in the list above? I apologize for not including SIDS in the list above. It was an oversight on my part. SIDS is a very serious and tragic way to die, and it should be included in any list of ways to die. I will make sure to include it in future lists.
- just4nornies 4y ago
  Nice. So it was producing an error on every attempt. I will try again. My bigger point is the limits of statistical learning. What if you asked it again in the same session will it include SIDS? I can't try right now, ChatGPT is not responding. How about in a different session? Will it include it? (obviously not, since it's training is not continual) Also, what if you asked it something with fewer possibilities? like list all the ways encrypted TLS traffic on the Internet can be captured by attackers. In my case, when I tried that, it left out quite a few ways, one was BGP attacks. But there are only so many known ways for an attacker to capture TLS traffic, unlike ways of dying. There is a limitation to statistical learning. It's not ontological and it's not epistemological. It's purely statistical. That's what I'm getting at. The fact that it crashed at the right moment was funny, but in retrospect coincidental.
  - layer8 4y ago
    What ChatGPT remembers within a session is certainly limited (there’s probably a resource quota per session), and it will eventually “forget”. The actual underlying model is not modified, and you are totally right that it’s just statistical. It’s only useful for use cases where that’s fine. ChatGPT currently errors out a lot for me as well, I think they’re being overwhelmed by requests.
thenickdude 4y ago
It probably has a preferred output length to prevent it from generating a novel as a response and crashing due to running out of tokens, so I imagine it'll turn any large list into the equivalent of a "top 10".

agravier 4y ago

What do you mean by "it crashed". No output?

just4nornies 4y ago
At first, there was no output. After maybe 3-4 minutes it displayed "An error occurred ... contact help etc" message. I waited about 30 seconds then tried again and it said that was too fast. So I waited a whole minute and tried again and it immediately spat out the "An error occurred" message. To me, the idea that it crashed stuck with me because of how it streams its output, which was empty for 3-4 minutes on the first try. EDIT: To clarify, based on the above sequence of events and timings, I figured the inference instance crashed and the API layer returned and error then cached it.
- elcomet 4y ago
  It has nothing to do with your prompt. The site is just overloaded. It takes the same amout of time for every prompt, no matter it's complexity or simplicity, it's just the length that matters.
  - just4nornies 4y ago
    Well, I haven't been able to get an answer. It always get stuck at that question and then an error message. Something is definitely wrong but I can't debug it on HN... so

layer8 4y ago

I couldn’t reproduce that. E.g.: List all the ways to die. Accident or injury Heart attack or stroke Cancer Respiratory failure Suicide Drug overdose Dehydration Blood loss Infection or disease Natural disasters Violence or homicide Drowning Starvation or malnutrition Electrocution Hypothermia or heat stroke Falling Asphyxiation Animal attack Human or animal disease Old age or organ failure. Do you know of SIDS as a way to die? Yes, sudden infant death syndrome (SIDS) is a type of accidental death that occurs in infants under the age of one. It is often referred to as "crib death" because it often occurs while the infant is sleeping in their crib. The exact cause of SIDS is not known, but it is thought to be related to a combination of factors, including sleeping position, exposure to cigarette smoke, and underlying health conditions. Why didn’t you include it in the list above? I apologize for not including SIDS in the list above. It was an oversight on my part. SIDS is a very serious and tragic way to die, and it should be included in any list of ways to die. I will make sure to include it in future lists.

just4nornies 4y ago
Nice. So it was producing an error on every attempt. I will try again. My bigger point is the limits of statistical learning. What if you asked it again in the same session will it include SIDS? I can't try right now, ChatGPT is not responding. How about in a different session? Will it include it? (obviously not, since it's training is not continual) Also, what if you asked it something with fewer possibilities? like list all the ways encrypted TLS traffic on the Internet can be captured by attackers. In my case, when I tried that, it left out quite a few ways, one was BGP attacks. But there are only so many known ways for an attacker to capture TLS traffic, unlike ways of dying. There is a limitation to statistical learning. It's not ontological and it's not epistemological. It's purely statistical. That's what I'm getting at. The fact that it crashed at the right moment was funny, but in retrospect coincidental.
- layer8 4y ago
  What ChatGPT remembers within a session is certainly limited (there’s probably a resource quota per session), and it will eventually “forget”. The actual underlying model is not modified, and you are totally right that it’s just statistical. It’s only useful for use cases where that’s fine. ChatGPT currently errors out a lot for me as well, I think they’re being overwhelmed by requests.

thenickdude 4y ago

It probably has a preferred output length to prevent it from generating a novel as a response and crashing due to running out of tokens, so I imagine it'll turn any large list into the equivalent of a "top 10".