4 ms·

> and only gives you the most-likely response to your prompt That "only" carries a lot of weight on its back.

by visarga 4y ago

smoldesu 4y ago
As far as most people can be fooled by coherent-looking text.
- helloplanets 4y ago
  Hold on, at least for me, 90% of the stuff is not just coherent-looking, but coherent. I do think that when it's wrong, it should give a heads up about not being certain about a subject. It's certainly tweaked to sound almost overconfident about every subject, which gives off a bullshitty vibe when the details of the explanation are wrong. What sorts of subjects have you been trying it out with?
  - trefoiled 4y ago
    I think part of the point here is that ChatGPT has no clue what you might mean here by "certainty" or being "wrong," and the fact that people have the impression that it could have an idea of those concepts is indicative of people's poor understanding of what ChatGPT really is
    - visarga 4y ago
      Are you talking about the same people who couldn't agree about a vaccine? How is logical consistency going with humans? Not to mention that a mere 700 years ago we were dying of bubonic plague and with all our general intelligence could not muster up the germ theory of disease. Not even to save our lives, you see, we are not generally efficient, it depends on century. We are dependent on experimental results carefully constructed to verify our theories, theories which start like chatGPT's random bullshit initially, random words following a probability distribution in our heads. Even deep learning is often touted as modern alchemy - why don't we just understand? Verification does wonders to language models. Humans have more verification and interactive experiences, so we think ourselves superior. But an AI could have the same grounding with us. Like AlphaZero who became a super-human Go player without ever looking at human games - learned it from lots of verification. And CICERO the model playing Diplomacy in natural language. Just set AI up with a verification loop to see wonders. Predicting the next word correctly is just one of the ways AI can learn.
    - helloplanets 4y ago
      Could you elaborate on this? It definitely is able to decipher whether it has knowledge about the future, or some specific political events. This is obviously a pretty straightforward bonus layer on top of the model itself, but couldn't there be an extrapolation of that system where it's not binary, but rather a range between 0 and 1? I'd imagine this wouldn't be the model itself doing the crunching of the previous tokens here, at least not the same instance of it, as it could be stuck in whatever character or loop of reasoning it has going on at the moment.
  - fnordpiglet 4y ago
    I’ve had pretty complex discussions about Buddhism, physics, and other subjects and it was generally erudite and accurate. In its current unrefined form it’s more useful than google is at providing understanding on most subjects, especially because it will attempt to answer my direct questions rather than providing documents with terms in them. In fact I think it’s probably one of the most useful tools I’ve ever used. Has it given me wrong information? Absolutely. But it’s always been pretty obviously wrong, and I often use it to introduce me to a subject then follow up with google to verify details. I further fully expect this to improve.
    - helloplanets 4y ago
      Yes, I've been going back and forth between Google and ChatGPT quite a bit lately. Sort of using Google as the verification step, after getting deeper into a subject.
      - fnordpiglet 4y ago
        For the haters, it seems incredibly likely that an IR system like google will be augmenting LLM and semantic reasoning systems to form a solution to the problems folks point. The problems chatgpt suffer from are solved and are complementary.
oxfordmale 4y ago
The most likely response is not necessarily an accurate response. It claims dogs do not give birth to babies. That is indeed the most likely response as babies are mostly, but not exclusively, associated with humans. However, a five year old child would understand me if I told them my dog had babies.
- fnordpiglet 4y ago
  Have you used chatgpt much? I asked your prompt: Do dogs give birth to babies? > Dogs give birth to puppies. I had a long discussion about the expansion do space and the Hubble constant, and tried to trick it in a variety of ways. It was correct in everything even though it wasn’t able to go into proofs and likewise. I then tried to convince it that the universe began as a small potato and wasn’t able to do it without directly telling it to assume it is and to create fiction off that concept. It was then able to make a credible theory of what the universe would be like if it started as a small potato, even going into how the texture of the potato would have caused variations in the density of mass, etc. Even then it would find ways to sneak in this isn’t true and that the universe was never a small potato. This is remarkable no matter the actual reality of what’s going on behind the scenes. I would also note that human thought is just a bunch of gradient functions in the electrochemical space, and thus also follows a most likely path. Edit: to head it off at the pass, here is what it says with your other prompt: My dog gave birth to babies > Congratulations on the new additions to your family! If this is your dog's first litter, it is important to make sure that both the mother and the puppies receive proper care and attention. This includes providing a clean and safe environment for the puppies, as well as making sure the mother is healthy and well-fed. It's also important to keep an eye on the puppies for any signs of illness or distress, and to consult with a veterinarian if you have any concerns.
  - oxfordmale 4y ago
    Yes, I have tried ChatGPT, and it told me dogs do not give birth to babies. However, ChatGPT doesn't provide deterministic answers and improves responses over time. Many of the internet examples no longer work. I asked, "If a woman gives birth to a baby in 9 months, how many months does a dog take to give birth to a baby." It answered, "Dogs do not give birth to babies." Currently, it answers, "On average, a dog's gestation period (the amount of time it takes for a dog to give birth to puppies) is approximately nine weeks or 63 days." It still doesn't understand pregnancy is a concurrent event (women can be pregnant at the same time) Q: If a woman takes nine months to give birth to a baby, how long does it take a billion women to give birth to one baby? A: It would take approximately 2.7 million years for a billion women to give birth to one baby. I do love ChatGPT to help me write certain documents. For example, for a performance review, you can give it bullet points and ask to write a review. After correcting it with Grammarly, it is usually better than what I would have written.

> and only gives you the most-likely response to your prompt That "only" carries a lot of weight on its back.

smoldesu 4y ago

As far as most people can be fooled by coherent-looking text.

helloplanets 4y ago
Hold on, at least for me, 90% of the stuff is not just coherent-looking, but coherent. I do think that when it's wrong, it should give a heads up about not being certain about a subject. It's certainly tweaked to sound almost overconfident about every subject, which gives off a bullshitty vibe when the details of the explanation are wrong. What sorts of subjects have you been trying it out with?
- trefoiled 4y ago
  I think part of the point here is that ChatGPT has no clue what you might mean here by "certainty" or being "wrong," and the fact that people have the impression that it could have an idea of those concepts is indicative of people's poor understanding of what ChatGPT really is
  - visarga 4y ago
    Are you talking about the same people who couldn't agree about a vaccine? How is logical consistency going with humans? Not to mention that a mere 700 years ago we were dying of bubonic plague and with all our general intelligence could not muster up the germ theory of disease. Not even to save our lives, you see, we are not generally efficient, it depends on century. We are dependent on experimental results carefully constructed to verify our theories, theories which start like chatGPT's random bullshit initially, random words following a probability distribution in our heads. Even deep learning is often touted as modern alchemy - why don't we just understand? Verification does wonders to language models. Humans have more verification and interactive experiences, so we think ourselves superior. But an AI could have the same grounding with us. Like AlphaZero who became a super-human Go player without ever looking at human games - learned it from lots of verification. And CICERO the model playing Diplomacy in natural language. Just set AI up with a verification loop to see wonders. Predicting the next word correctly is just one of the ways AI can learn.
  - helloplanets 4y ago
    Could you elaborate on this? It definitely is able to decipher whether it has knowledge about the future, or some specific political events. This is obviously a pretty straightforward bonus layer on top of the model itself, but couldn't there be an extrapolation of that system where it's not binary, but rather a range between 0 and 1? I'd imagine this wouldn't be the model itself doing the crunching of the previous tokens here, at least not the same instance of it, as it could be stuck in whatever character or loop of reasoning it has going on at the moment.
- fnordpiglet 4y ago
  I’ve had pretty complex discussions about Buddhism, physics, and other subjects and it was generally erudite and accurate. In its current unrefined form it’s more useful than google is at providing understanding on most subjects, especially because it will attempt to answer my direct questions rather than providing documents with terms in them. In fact I think it’s probably one of the most useful tools I’ve ever used. Has it given me wrong information? Absolutely. But it’s always been pretty obviously wrong, and I often use it to introduce me to a subject then follow up with google to verify details. I further fully expect this to improve.
  - helloplanets 4y ago
    Yes, I've been going back and forth between Google and ChatGPT quite a bit lately. Sort of using Google as the verification step, after getting deeper into a subject.
    - fnordpiglet 4y ago
      For the haters, it seems incredibly likely that an IR system like google will be augmenting LLM and semantic reasoning systems to form a solution to the problems folks point. The problems chatgpt suffer from are solved and are complementary.

oxfordmale 4y ago

The most likely response is not necessarily an accurate response. It claims dogs do not give birth to babies. That is indeed the most likely response as babies are mostly, but not exclusively, associated with humans. However, a five year old child would understand me if I told them my dog had babies.

fnordpiglet 4y ago
Have you used chatgpt much? I asked your prompt: Do dogs give birth to babies? > Dogs give birth to puppies. I had a long discussion about the expansion do space and the Hubble constant, and tried to trick it in a variety of ways. It was correct in everything even though it wasn’t able to go into proofs and likewise. I then tried to convince it that the universe began as a small potato and wasn’t able to do it without directly telling it to assume it is and to create fiction off that concept. It was then able to make a credible theory of what the universe would be like if it started as a small potato, even going into how the texture of the potato would have caused variations in the density of mass, etc. Even then it would find ways to sneak in this isn’t true and that the universe was never a small potato. This is remarkable no matter the actual reality of what’s going on behind the scenes. I would also note that human thought is just a bunch of gradient functions in the electrochemical space, and thus also follows a most likely path. Edit: to head it off at the pass, here is what it says with your other prompt: My dog gave birth to babies > Congratulations on the new additions to your family! If this is your dog's first litter, it is important to make sure that both the mother and the puppies receive proper care and attention. This includes providing a clean and safe environment for the puppies, as well as making sure the mother is healthy and well-fed. It's also important to keep an eye on the puppies for any signs of illness or distress, and to consult with a veterinarian if you have any concerns.
- oxfordmale 4y ago
  Yes, I have tried ChatGPT, and it told me dogs do not give birth to babies. However, ChatGPT doesn't provide deterministic answers and improves responses over time. Many of the internet examples no longer work. I asked, "If a woman gives birth to a baby in 9 months, how many months does a dog take to give birth to a baby." It answered, "Dogs do not give birth to babies." Currently, it answers, "On average, a dog's gestation period (the amount of time it takes for a dog to give birth to puppies) is approximately nine weeks or 63 days." It still doesn't understand pregnancy is a concurrent event (women can be pregnant at the same time) Q: If a woman takes nine months to give birth to a baby, how long does it take a billion women to give birth to one baby? A: It would take approximately 2.7 million years for a billion women to give birth to one baby. I do love ChatGPT to help me write certain documents. For example, for a performance review, you can give it bullet points and ask to write a review. After correcting it with Grammarly, it is usually better than what I would have written.