5 ms·
Human mind can perform actual reasoning, while ChatGPT only mirrors the output of reasoning and when it gets output correctly it's due to mixture of luck and cl
by scotty79 4y ago
Human mind can perform actual reasoning, while ChatGPT only mirrors the output of reasoning and when it gets output correctly it's due to mixture of luck and closeness to training material.
Human mind or even something like Wolfram Alpha can perform reasoning.
- maxdoop 4y agoCan you explain your proof of that?
- lionkor 4y agoNot OP, but basically: Humans have the capacity to come up with new language, new ideas, and basically everything in our human world was made up by someone. ChatPT or similar, without any training data, cannot do this. Thus they're simply imitating
- deskamess 4y agoHumans are not trained? How much of training is responsible for humans being able to come up with new language and new ideas?
- lionkor 4y agoThats assuming modern humans, I was talking about ancient humans, before civilisation. You could argue thats where the creative mind shows up most, as there are very few humans to imitate.
- sebzim4500 4y agoWhat experiment can you do to confirm this? If I ask ChatGPT to come up with a new language, it will do it. How do I distinguish that from what a human comes up with?
- lionkor 4y agoBy not giving them any examples of language. I would expect humans to come up with a language, if not vocal, without guidance. I doubt GPT would do anything without training data to imitate.
- glandium 4y agoHumans can't either, without training data. The biggest difference between chatGPT and humans is that humans are not trained solely on language.
- rvnx 4y agoI think this is going to change very soon. Based on the current advances, in about a year we should see the first real-world interaction robot that learns from its environment (probably Tesla or OpenAI). I'm curious (just leaving it here to see what happens in the future), what will be the excuse of Google this time. This is again the same situation: Google has supposedly superior tech but not releasing it (or maybe it's as good as Bard...)
- mchaver 4y agoThe important difference is that humans are trained on a lot less data than ChatGPT. This implies that the human brain and LLMs are very different, the human brain likely has a lot of language faculties pre-encoded (this is the main argument of Universal Grammar). OpenAI's GPT 4 is now trained on visual data. Anyway, I think a lot of ongoing conversations have orthogonal arguments. ChatGPT can be both impressive and generate topics broader than the average human while not giving us deeper insight into how human language works.
- _heimdall 4y agoChatGPT and similar do seem to make new things, arguably they do it more freely than the average adult human. Art generators are the most obvious example to me. They regularly create depictions of entirely new animals that may look like a combination of known species. People got a kick out of art AIs struggling to include words as we recognize them. How can we say what looked like gibberish to us wasn't actually part of a language the AI invented as part of the art piece, like Tolkien inventing elvish for a book?
- maxdoop 4y agoHumans require training data as well. And what do you think of the Mark Twain quote: “ There is no such thing as a new idea. It is impossible. We simply take a lot of old ideas and put them into a sort of mental kaleidoscope. We give them a turn and they make new and curious combinations. We keep on turning and making new combinations indefinitely; but they are the same old pieces of colored glass that have been in use through all the ages.” I’d argue ChatGPT can indeed be creative, as it can combine ideas in new ways.
- lionkor 4y agoYou could argue like that against anything
- aqme28 4y agoPlenty of examples of it coming up with new languages or ideas. And it’s very hard for a person to come up with a new language completely independent of reference to other known languages.
- scotty79 4y agoJust try to talk with it about math. You'll quickly see that it's as if you talked to a person who doesn't understand anything about math. Just read some books about it and attempts to mimic their style to appear to be smart and knowledgable.
- canadianfella 4y ago[dead]
- rvnx 4y agoWithout any external plugins, GPT can encode and decode base64 strings that are totally new. Again "luck" ? If a system is so lucky that it gives you the right answer 9 times out of 10, it's perhaps not luck anymore.
- Kuinox 4y agoIt cannot, encode base64 it only remember, see this conversation: https://news.ycombinator.com/item?id=34322223 https://news.ycombinator.com/item?id=34322223
- rvnx 4y agoIt totally can (try it if you don't believe it). In your message you say it is gibberish, but I have completely different results and get very good Base64 on super long and random strings. I frequently use Base64 (both ways) to bypass filters in both GPT-3 and 4/Bing so I'm sure it works ;) It sometimes make very small mistakes but overall amazing. At this stage if it can work on random data that never appeared in the training set it's not just luck, it means it has acquired that skill and learnt how to generalise it.
- Kuinox 4y agoDid you tried longer sentence and not singles words? Did you also read the conversation? Edit: ok it looks like it can now convert in base64, I'm sure it couldn't when I tested 2 months ago.
- MacsHeadroom 4y agoIt could when I tested 1 week after the first version of chatGPT was in private beta. It's always been able to convert base64 both ways. It sometimes gets some of the conversion wrong or converts a related word instead of the word you actually asked it to convert. This strongly suggests that it's the actual LLM doing the conversion (and there's no reason to believe it wouldn't be). This behavior will likely be replicated in open source LLMs soon.
- aqme28 4y agoAsk it to “reason through” a problem and then ask it to give you an answer. How’s that different from thinking?
- scotty79 4y agoIt's just wrong. That's how you can tell. Actual reasoning leads to sensible conclusions.
- aqme28 4y agoComing to the wrong conclusion doesn’t mean I wasn’t thinking through the problem.
- scotty79 4y agoIt definitely means that it was thinking wrongly if at all. Just talk to GPT about math. You'll quickly change your mind about the possibility of it thinking.
- stevenhuang 4y agoLLMs are bad at arithmetic due to tokenization limitations but they're actually pretty decent at mathematical reasoning. You don't know what you're talking about I'm afraid. https://www.lesswrong.com/posts/qy5dF7bQcFjSKaW58/bad-at-arithmetic-promising-at-math https://www.lesswrong.com/posts/qy5dF7bQcFjSKaW58/bad-at-ari...
- scotty79 4y agoPlease just try. It's horrible at mathematical reasoning. Use just words to avoid problems with tokenization. Alternatively just read through the link you provided. It has many examples of failures of GPT and gabage it produces when talked to about math.
- 4y ago