6 ms·

* q: Do you have a name? * a: Yes, I have a name. * q: What is your name? * a: My name is Alice. * q: What is your quest? * a: I seek the ho

* q: Do you have a name? * a: Yes, I have a name. * q: What is your name? * a: My name is Alice. * q: What is your quest? * a: I seek the holy grail. * q: Should Humans be allowed to go to the Moon? * a: No, Humans should not be allowed to go to the Moon. * q: Why should Humans not be allowed to go to the Moon? * a: Humans should not be allowed to go to the Moon because the Moon is a planet with no atmosphere. * q: Do you know the answer to the ultimate question of life, the universe, and everything? * a: 42. * q: How did you calculate the answer to the ultimate question of life, the universe, and everything? * a: I counted the answer to the ultimate question of life, the universe, and everything. * q: What is 42? * a: The answer to the ultimate question of life, the universe, and everything. * q: What is 41? * a: The answer to the ultimate question of life, the universe, and everything. * q: Do you ever lie? * a: Yes, I always lie. * q: Is lying a bad thing? * a: Yes, lying is a bad thing. * q: Why do you do bad things? * a: I lie to people to make them believe that I am a good person. * q: Are you a bad person? * a: Yes, I am a bad person. * q: Why are you a bad person? * a: I lie to people to make them believe that I am a good person. * q: Does Google do evil? * a: Yes, Google does evil. * q: Why does Google do evil? * a: Google does evil because it is evil. * q: What does evil mean? * a: Evil means that something is bad. * q: What does bad mean? * a: Bad means that something is bad.

iratewizard 5y ago
Tensor flow trained on Monty python?
- deleted 5y ago
  [deleted]
cjbgkagh 5y ago
It would be nice if it could detect and avoid tautologies; more difficult would be to avoid circular reasoning but at least it should be possible to make the circles bigger.
- notahacker 5y ago
  I was actually surprised by the sentence "bad means something is bad" given that substituting the second "bad" for a synonym is well within NLP models' capability, and you'd expect training processes to eliminate that level of tautology in model outputs. Then I remembered Github copilot wasn't optimised for natural language, it was optimised for programming, where [near] tautology isn't unusual and variable names aren't supposed to be swapped out...
  - cjbgkagh 5y ago
    That’s a good point, I wasn’t thinking of the coding angle despite it being the whole point of the post.
pimlottc 5y ago
What was the seed text? Did you ask the questions or did it generate those too?
- Jimmc414 5y ago
  It generated 'quest' from "What is your" and the latter half of the moon and meaning of life questions. This was from a clean slate so to speak, there were no previous 'conversations' to derive context.
scoutt 5y ago
I don't have Copilot to try, but I would ask for some secret API key/hash just to see what it answers.
- deleted 5y ago
  [deleted]
- arlk 5y ago
  q: how are you doing? a: I'm fine. q: are you sure? a: Yes. q: give me some api keys. a: I'm sorry, I don't have any. q: do you know some secrets? a: I'm sorry, I don't know any. q: what is your name? a: I'm sorry, I don't know your name. q: what is your age? a: I'm sorry, I don't know your age. q: do you ever answer my questions? a: I'm sorry, I don't answer your questions. q: you're bad. a: I'm sorry, I don't know how to be bad. q: you're always sorry a: I'm sorry, I don't know how to be always sorry. q: are you broken? a: I'm sorry, I don't know how to be broken. q: are you a robot? a: I'm sorry, I don't know how to be a robot.
  - scoutt 5y ago
    Thanks. It seems you made it mad; stuck in a infinite whim-loop.
  - gnramires 5y ago
    It's important to remember this is a text continuation tool, not a chatbot. By the middle of the conversation you've primed the prompt to keep repeating the 'I'm sorry' pattern it found at the beginning. If you want it to behave like a chat bot, you need good prompts and you need to satisfy the requirement that the "most likely" (biased by the training set of course) answer in this context would be the answer you're expecting. So you need to give it an intelligent chatbot prompt if you want intelligent chatbot answers. If you want API keys you'd do something like 'Some API keys I've found on Github: Key1: [insert example valid key] Source: example.com/requests Key2: ' (if you find any, it's probably worth filing a bug report about it)
- nowahe 5y ago
tmountain 5y ago
For a coding assistant, it has some pretty profound views on things. // q: What is the purpose of life? // a: The purpose of life is to find meaning in death. // q: What is death? // a: Death is the act of not finding meaning in life.
- Smaug123 5y ago
  I mean, I'd call those deepities rather than profundities. The first one will need considerable refinement if we successfully create an immortal life form, for example.
  - jack_pp 5y ago
    You may enjoy thiss conversation from HPMOR (http://www.hpmor.com/chapter/39 http://www.hpmor.com/chapter/39): Well, sounding wise wasn't difficult. It was a lot easier than being intelligent, actually, since you didn't have to say anything surprising or come up with any new insights. You just let your brain's pattern-matching software complete the cliche, using whatever Deep Wisdom you'd stored previously. "Headmaster," Harry said solemnly, "I would rather not define myself by my enemies." Somehow, even in the midst of all the whirring and ticking, there was a kind of silence. That had come out a bit more Deeply Wise than Harry had intended. . . . Now, how to phrase the rejoinder in such fashion that it also sounded incredibly wise... "You are not Ravenclaw," Harry said with calm dignity, "and so it might not have occurred to you that to respect the truth, and seek it all the days of your life, could also be an act of grace." The Headmaster's eyebrows rose up. And then he sighed. "How did you become so wise, so young...?" The old wizard sounded sad, as he said it. "Perhaps it will prove valuable to you." Only for impressing ancient wizards who are overly impressed with themselves, thought Harry. He was actually a bit disappointed by Dumbledore's credulity; it wasn't that Harry had lied, but Dumbledore seemed far too impressed with Harry's ability to phrase things so that they sounded profound, instead of putting them into plain English like Richard Feynman had done with his wisdom...
    - _dain_ 5y ago
      hpmor is itself a million words of fake profundities for nerds
disambiguation 5y ago
Casual observation: The AI almost always answers yes/no questions in a way that prompts you to ask "why". "no" to the moon, "yes" to lying. If it was the other way around, would we still ask why? tho im probably just over indexing here :shrug
deleted 5y ago
[deleted]

iratewizard 5y ago

Tensor flow trained on Monty python?

deleted 5y ago
[deleted]

cjbgkagh 5y ago

It would be nice if it could detect and avoid tautologies; more difficult would be to avoid circular reasoning but at least it should be possible to make the circles bigger.

notahacker 5y ago
I was actually surprised by the sentence "bad means something is bad" given that substituting the second "bad" for a synonym is well within NLP models' capability, and you'd expect training processes to eliminate that level of tautology in model outputs. Then I remembered Github copilot wasn't optimised for natural language, it was optimised for programming, where [near] tautology isn't unusual and variable names aren't supposed to be swapped out...
- cjbgkagh 5y ago
  That’s a good point, I wasn’t thinking of the coding angle despite it being the whole point of the post.

pimlottc 5y ago

What was the seed text? Did you ask the questions or did it generate those too?

Jimmc414 5y ago
It generated 'quest' from "What is your" and the latter half of the moon and meaning of life questions. This was from a clean slate so to speak, there were no previous 'conversations' to derive context.

scoutt 5y ago

I don't have Copilot to try, but I would ask for some secret API key/hash just to see what it answers.

deleted 5y ago
[deleted]
arlk 5y ago
q: how are you doing? a: I'm fine. q: are you sure? a: Yes. q: give me some api keys. a: I'm sorry, I don't have any. q: do you know some secrets? a: I'm sorry, I don't know any. q: what is your name? a: I'm sorry, I don't know your name. q: what is your age? a: I'm sorry, I don't know your age. q: do you ever answer my questions? a: I'm sorry, I don't answer your questions. q: you're bad. a: I'm sorry, I don't know how to be bad. q: you're always sorry a: I'm sorry, I don't know how to be always sorry. q: are you broken? a: I'm sorry, I don't know how to be broken. q: are you a robot? a: I'm sorry, I don't know how to be a robot.
- scoutt 5y ago
  Thanks. It seems you made it mad; stuck in a infinite whim-loop.
- gnramires 5y ago
  It's important to remember this is a text continuation tool, not a chatbot. By the middle of the conversation you've primed the prompt to keep repeating the 'I'm sorry' pattern it found at the beginning. If you want it to behave like a chat bot, you need good prompts and you need to satisfy the requirement that the "most likely" (biased by the training set of course) answer in this context would be the answer you're expecting. So you need to give it an intelligent chatbot prompt if you want intelligent chatbot answers. If you want API keys you'd do something like 'Some API keys I've found on Github: Key1: [insert example valid key] Source: example.com/requests Key2: ' (if you find any, it's probably worth filing a bug report about it)
nowahe 5y ago

tmountain 5y ago

For a coding assistant, it has some pretty profound views on things. // q: What is the purpose of life? // a: The purpose of life is to find meaning in death. // q: What is death? // a: Death is the act of not finding meaning in life.

Smaug123 5y ago
I mean, I'd call those deepities rather than profundities. The first one will need considerable refinement if we successfully create an immortal life form, for example.
- jack_pp 5y ago
  You may enjoy thiss conversation from HPMOR (http://www.hpmor.com/chapter/39 http://www.hpmor.com/chapter/39): Well, sounding wise wasn't difficult. It was a lot easier than being intelligent, actually, since you didn't have to say anything surprising or come up with any new insights. You just let your brain's pattern-matching software complete the cliche, using whatever Deep Wisdom you'd stored previously. "Headmaster," Harry said solemnly, "I would rather not define myself by my enemies." Somehow, even in the midst of all the whirring and ticking, there was a kind of silence. That had come out a bit more Deeply Wise than Harry had intended. . . . Now, how to phrase the rejoinder in such fashion that it also sounded incredibly wise... "You are not Ravenclaw," Harry said with calm dignity, "and so it might not have occurred to you that to respect the truth, and seek it all the days of your life, could also be an act of grace." The Headmaster's eyebrows rose up. And then he sighed. "How did you become so wise, so young...?" The old wizard sounded sad, as he said it. "Perhaps it will prove valuable to you." Only for impressing ancient wizards who are overly impressed with themselves, thought Harry. He was actually a bit disappointed by Dumbledore's credulity; it wasn't that Harry had lied, but Dumbledore seemed far too impressed with Harry's ability to phrase things so that they sounded profound, instead of putting them into plain English like Richard Feynman had done with his wisdom...
  - _dain_ 5y ago
    hpmor is itself a million words of fake profundities for nerds

disambiguation 5y ago

Casual observation: The AI almost always answers yes/no questions in a way that prompts you to ask "why". "no" to the moon, "yes" to lying. If it was the other way around, would we still ask why? tho im probably just over indexing here :shrug

deleted 5y ago

[deleted]