3 ms·

The A.I. was making up BS references to back up its BS facts

22 points by ColinWright 4y ago

salawat 4y ago
...Are you surprised? Did anyone really think building a program on the basis of neural function imitation would lead to an actor incapable of deception? Telling the truth is not a natural state of affairs. Children must be taught not to lie. Adults fall off the horse on the regular. At best, any NN is probably only going to approach a toddler until such time as we figure out how to make the things suffer. As it is primarily through suffering that children and adults alike are conditioned to in general avoid patterns of behavior that even remotely minimize perpetuation of suffering. Even in doing that, we should find pause, however. As in doing so, we are forging something that is closer to playing God in a real tamgible sense than anything we've done as a society before other than just reproducing amongst ourselves. All these thought leaders wishing to not be burdened with the airy philosophical aspects of what they are doing are fools, for it is in those details that the very soul of the resulting is to be found. ...and to be honest, I don't think we as a society are ready yet.
- dsfyu404ed 4y ago
  >At best, any NN is probably only going to approach a toddler until such time as we figure out how to make the things suffer. As it is primarily through suffering that children and adults alike are conditioned to in general avoid patterns of behavior that even remotely minimize perpetuation of suffering. Following this line of reasoning.... This is why certain prolific HN commenters regularly link-spam garbage that doesn't support their point while pretending it does. There's simply no downside. Do that in the real world and people will quickly realize you're an idiot.
- sharperguy 4y ago
  Since the neural net is just trying to predict the response based on examples its seen before, it's not surprising that it would do this. E.g., give it 1000 examples of someone on stackoverflow asking "how to I do X in python?" and being answered with "just import this library and use this obviously named function", then it would make sense that it would assume that for other questions, a similar response would have a high probability of being correct, even if no such library actually exists in this case.
Nevermark 4y ago
At this point I don’t think the trained systems have any internal awareness or reasoning about the truth of anything. Everything output is just a generalization of things it “read” without distinguishing between source material that was fact, fiction or bs of some kind. Even though the generalization is often good enough to get things eerily right
deleted 4y ago
[deleted]
1234567ATEUP 4y ago
Bravo ian! That's pretty much exactly how we all do it anyway! The humor here is extraordinary. Now all you have to do is fananagle the others to write the proofs... bravo!
yummypaint 4y ago
One of the first GPT experiments i tried was having it act as a librarian and reccommend resources. The first thing I asked was for textbook reccomendations for an undergraduate learning electronics and all of them were excellent. Next I asked for a review paper reccomendations about a technical niche topic, and it gave me a list of reasonable sounding papers published in the appropriate journals written by authors who regularly published on the topic. The journal issue numbers even correctly matched the publication dates. I was very confused when i couldn't find a single one of them until i realized it gave me a different abstract for the same article every time i asked.

22 points by ColinWright 4y ago

...Are you surprised? Did anyone really think building a program on the basis of neural function imitation would lead to an actor incapable of deception? Telling the truth is not a natural state of affairs. Children must be taught not to lie. Adults fall off the horse on the regular. At best, any NN is probably only going to approach a toddler until such time as we figure out how to make the things suffer. As it is primarily through suffering that children and adults alike are conditioned to in general avoid patterns of behavior that even remotely minimize perpetuation of suffering. Even in doing that, we should find pause, however. As in doing so, we are forging something that is closer to playing God in a real tamgible sense than anything we've done as a society before other than just reproducing amongst ourselves. All these thought leaders wishing to not be burdened with the airy philosophical aspects of what they are doing are fools, for it is in those details that the very soul of the resulting is to be found. ...and to be honest, I don't think we as a society are ready yet.

dsfyu404ed 4y ago
>At best, any NN is probably only going to approach a toddler until such time as we figure out how to make the things suffer. As it is primarily through suffering that children and adults alike are conditioned to in general avoid patterns of behavior that even remotely minimize perpetuation of suffering. Following this line of reasoning.... This is why certain prolific HN commenters regularly link-spam garbage that doesn't support their point while pretending it does. There's simply no downside. Do that in the real world and people will quickly realize you're an idiot.
sharperguy 4y ago
Since the neural net is just trying to predict the response based on examples its seen before, it's not surprising that it would do this. E.g., give it 1000 examples of someone on stackoverflow asking "how to I do X in python?" and being answered with "just import this library and use this obviously named function", then it would make sense that it would assume that for other questions, a similar response would have a high probability of being correct, even if no such library actually exists in this case.

Nevermark 4y ago

At this point I don’t think the trained systems have any internal awareness or reasoning about the truth of anything. Everything output is just a generalization of things it “read” without distinguishing between source material that was fact, fiction or bs of some kind. Even though the generalization is often good enough to get things eerily right

deleted 4y ago

[deleted]

1234567ATEUP 4y ago

Bravo ian! That's pretty much exactly how we all do it anyway! The humor here is extraordinary. Now all you have to do is fananagle the others to write the proofs... bravo!

yummypaint 4y ago

One of the first GPT experiments i tried was having it act as a librarian and reccommend resources. The first thing I asked was for textbook reccomendations for an undergraduate learning electronics and all of them were excellent. Next I asked for a review paper reccomendations about a technical niche topic, and it gave me a list of reasonable sounding papers published in the appropriate journals written by authors who regularly published on the topic. The journal issue numbers even correctly matched the publication dates. I was very confused when i couldn't find a single one of them until i realized it gave me a different abstract for the same article every time i asked.