3 ms·
I don't even understand what understanding exactly means, perhaps anyone who understands it, can enlighten me? Do I, myself understand? Stand under what exactl
by mewpmewp2 3y ago
I don't even understand what understanding exactly means, perhaps anyone who understands it, can enlighten me?
Do I, myself understand? Stand under what exactly? What is that supposed to mean?
- ocbyc 3y agoTransformers are just pattern matching. So if you write "give me a list of dog names" it knows that "Spot" should be in that result set. Even though it doesn't really know what a dog is, a list is, or what a spot is.
- bongodongobob 3y agoI don't think that's true. They clearly group related things together and seem to be able to create concepts that aren't specifically in the training data. For example, it will figure out the different features of a face, eyes, nose, mouth even if you don't explicitly tell it what those are. Which is why they are so cool.
- mewpmewp2 3y agoThey are cool, but then you are also cool.
- zeusk 3y agoMost of that magic comes from embedding no? which is clustering things by their relation in some N-dimensional space
- bongodongobob 3y agoExactly. It figures that out on its own. That's what "understanding" looks like in this context, imo.
- rafaelero 3y ago> Transformers are just pattern matching. That's trivially true. The question is: are we any different?
- parpfish 3y agoI approach LLMs with the perspective that “maybe this demonstrates that we humans are all just stochastic parrots?”and we should have the null hypothesis that humans are just pattern matchers.
- mewpmewp2 3y agoThis is the way I perceive my thoughts. I don't know what I'm going to think of beforehand or in advance, these could all be stochastic "tokens" based on what I've observed in my life. So of course I feel a bit offended when people claim LLMs are just stochastic parrots, because it doesn't feel to me, that I'm specifically any better? My thoughts - they just happen, and sometimes not in my favor - I have had times of depression, I didn't have control over my thoughts. Neither do I have now, but at least I am in a better place. Because the "happiness" chemicals are regulated to be in a more favorable state to me for various different factors. I didn't know what I was going to comment in response to your comment, I was just streaming my conscious.
- richardw 3y agoI think so. You ask that question because you’re interrogating the position, not because 1000 humans have asked that question in similar situations. You and I know there’s a truth and we’d like to find it. The GPT is just happy (I.e. rewarded) to produce frequently used tokens.
- ALittleLight 3y agoCan you describe a test that would separate trivial pattern matching from true understanding?
- lottin 3y agoA simple conversation would do.
- mewpmewp2 3y agoCould you share a conversation link with GPT-4 with either about a "list" or a "dog", to determine whether it truly understands one of those things compared to a human?
- lottin 3y agoI don't have a GPT account. I would start with: "Do you like dogs?" Next question: "Why?"
- mewpmewp2 3y agoIt kind of answered "why" for me """I think dogs are wonderful! They're known for their loyalty, playfulness, and their ability to bring joy to people's lives. What about you? Do you have a favorite breed or dog story?""" What do I ask next?
- lottin 3y agoThis reply sounds so fake that in my opinion should be enough to rule out any hint of intelligence. However if you insist I'd continue with this: "I'm not a fan of dogs. I do know a few dogs though. Sometimes I invite my neighbour's dog for dinner. He's got good taste, for a dog. The last time he came around we talked about the situation in the Middle East. Do you know a good book about this topic that I could recommend to him?"
- bongodongobob 3y ago
- mewpmewp2 3y agoHow would I test whether I "know" or "understand" what a dog is?
- notahacker 3y agoOh, that's easy, we just give the dog a keyboard and see if you accurately identify it's a dog from your text based interactions ;-)
- mewpmewp2 3y agoAre you calling me a dog?
- inopinatus 3y agoEven this seems too grand a claim. I’d water it down thus: the LLM encodes that the token(s) for “Spot” are probabilistically plausible in the ensuing output.
- bongodongobob 3y ago...because it understands what a dog name is. Why wouldn't you see Gary or Florence in that list? How does it know those aren't dog names? You can't be suggesting it has memorized relationships between all concepts, the model would be enormous. So clearly, there is something else going on. It's able to encode concepts/ideas.
- inopinatus 3y agoThe model is enormous, and N-dimensional for very high N. But the model remains insufficiently enormous for understanding, and moreover, the model cannot observe itself and adjust. Ask an LLM to extrapolate, see any semblance of reason collapse.
- mewpmewp2 3y agoExtrapolate what?
- advael 3y agoSolipsism is truly the best fully-general counterargument
- mewpmewp2 3y agoTo AI? Or that you are not a NPC?
- advael 3y agoTo anything, that's what "fully-general" means
- mewpmewp2 3y agoSo you are a bot?
- advael 3y agoI mean from your perspective I'm just a name making more words on your screen, right? Don't worry too much about it, buddy, you're doin' great :)
- mewpmewp2 3y agoHaha, you are funny! What's the weather tomorrow? Please also remind me tomorrow to put my gym clothes to washer and dry them after.
- advael 3y agoI can't spoil the weather tomorrow (it's a major plot point) but I can tell you that fortune has been tweaked to favor the bold by an additional 10%, just for tomorrow. Laundry service is complimentary, but our records show that you haven't registered your home. Would you like to register your home address at this time?
- richardw 3y agoThe fact that you ask that is in many ways the difference. You feel there’s a limitation in your knowledge of the term “understand” and its use in this context and would like clarification before you’re more certain, either way. At some point either enough information arrives to convince you, or you decide it’s not true. Whatever that process and internal states are, is something GPT can’t do. It’ll 100% confidently produce something and be fully rewarded that it chose tokens that humans would most likely choose given the preceding tokens. There’s no “aha”.
- mewpmewp2 3y agoBut it frustratingly, frequently tells me it doesn't have enough data or other XYZ reasons to why it can't answer my weird questions.
- modriano 3y agoTo understand means a few things, but they all essentially boil down to having a correct (or at least correct enough to be useful for your usecase(s)) model for something in your head. Have you told someone something like "no, don't do it that way because <insert non-obvious downstream problem>, instead, do <insert alternative strategy that achieves better outcomes>"? That's an artifact of understanding and of the model you've developed for that thing. It's well described as a mixture of knowledge and wisdom, and is essentially the property of knowing the effect that pulling a lever will cause, coupled with good judgement about how, when, and why to pull the lever.
- mewpmewp2 3y agoBut GPT-4 has told me that as well? Usually in a bit more polite way. That my approach is a "novel" and an "interesting" approach, hinting that it's really probably not the best option here.