3 ms·
ChatGPT is nothing more than long-form autocomplete. The specifics of approach are irrelevant.
by shanebellone 4y ago
ChatGPT is nothing more than long-form autocomplete. The specifics of approach are irrelevant.
- imposter 4y agoA human brain is nothing more than long-form autocomplete. The specifics of approach are irrelevant.
- FrustratedMonky 4y agoExactly. All the people saying LLM's aren't important because it is just auto-complete, really don't connect the dots that humans are also just auto-complete.
- ChatGTP 4y agoWhat on earth are you talking about?
- ricardobeat 4y agoOur brain excels at pattern matching. We attribute a lot of human abilities to “intelligence”, but the line between that and pattern-matching (or “autocomplete” ad it’s being referred as here) is being challenged by these latest LLMs. If it can look at a picture, explain what’s in it, and hypothesize about physics inside the picture’s environment, is it “just pattern matching”?
- shanebellone 4y ago"If it can look at a picture, explain what’s in it, and hypothesize about physics inside the picture’s environment, is it “just pattern matching”?" That's extrapolation via approximation. Computers synthesize a specification. The difference is nuanced and entirely contextual.
- ricardobeat 4y agoThose are way too broad terms for this conversation to go anywhere. The point is, what's to say the LLM is not doing "extrapolation via approximation" or some process that is analog to how we think? We barely understand how the brain works to start with.
- modriano 4y agoBut the human brain is a much more mature product (although I will concede there are still a ton of bugs to work out that we really have no idea how to repair because the product is extremely complex and still pretty fragile).
- makeworld 4y agoEveryone likes to say this, but no one seems to provide evidence. I don't believe it.
- lamp987 4y agoWhy do you think that?
- auggierose 4y agoI knew something changed after AlphaGo. Compute could do what we thought only true intelligence can do. So I agree, LLMs are not a black swan. It will change everything, nevertheless. I keep reading these opinions that LLMs are just doing some advanced form of copy paste. Actually, we don't know what they are doing. Are they actually doing some form of modelling and abstraction? Seems likely to me.
- Jensson 4y agoAlphaGo is basically the same as image recognition, not sure why you thought AlphaGo was special compared to detecting faces. AlphaGo works the same way but maps game structures on a Go board instead of mapping facial structures and comparing those to known people.
- FrustratedMonky 4y agoIt was able to beat the top GO player. What does it matter if that technology is also used in image recognition. I'd say that if its 'brain' can play games and recognize people, or in case of ChatGPT4, can talk and play chess, this is all starting to sound pretty 'General' to me.
- auggierose 4y agoThat's exactly the kind of attitude I am talking about. You can rationalise pretty much everything and keep moving the goal post. I've seen AI do something nobody thought was possible. If that doesn't influence how you think about AI I cannot help you.
- kthejoker2 4y agoNobody?
- auggierose 4y agoWell, maybe the self-driving car people thought it was possible. But I don't take them seriously.
- johnthewise 4y agonext bit prediction, or long-form autocomplete, may lead to general intelligence. http://mattmahoney.net/dc/rationale.html http://mattmahoney.net/dc/rationale.html