3 ms·
yep, it is just a glorified markov chain
by guluarte 2y ago
yep, it is just a glorified markov chain
- bloomingkales 2y agoThis glorified Markov chain educates me better than many things. Why are people so intent on calling bullshit on AI? It might be a disease honestly.
- joshdavham 2y ago> Why are people so intent on calling bullshit on AI? I hate to be an armchair psychologist, but I think it’s insecurity.
- tsunamifury 2y agoAnd preference for deferring to historical authority which I find so laughable in this forum. Everything said here has been said the same about the internet and Wikipedia but now those are the authorities.
- flipthefrog 2y agoAnd flying cars
- tiahura 2y agoI think to most people, AGI means KITT or at least Data. AI via word probability matrices is super cool and well worth $20/mo, but it’s not AGI.
- joshdavham 2y agoI've heard variants of this such as linear algebra isn't AGI and I'm always left thinking 'why not?' When I think of the human brain, I don't feel that electric zaps propagating through pink jello is any more sophisticated.
- tim333 2y ago"Word probability matrices" is definitely lacking something. A lot of human thinking is more along the lines of shape rotating and sounds and smells and other stuff.
- talldayo 2y agoBecause "educating you better than most things" and "unavoidably generating bullshit" are not mutually exclusive. It's entirely possible that AI is better than human conversation on the spectrum of "adhering perfectly to truth" but it's far-and-away less credible than an encyclopedia or even a peer-reviewed paper. Publishers know they cannot publish false information without spoiling their reputation. ChatGPT lies like it's life depends on it. Therefore, me and many others identify ChatGPT by it's willingness to create tangents of pure and unadulterated bullshit.
- r3trohack3r 2y agoI remember many instances in childhood where I began to realize authority figures, parents/teachers/etc., that I had been trusting to teach me the ways of life weren’t all knowing. Moments of “lies” (using your term, really just being incorrect) where the cracks began to show. I treat ChatGPT like a 90th percentile educator across many problem domains. Is it going to be wrong? Yes. Is to going to be very wrong? Yes. Is it capable of generating tangents of pure and unadulterated bullshit? Yes. But that was true of every teacher, professor, and mentor I’ve ever had. Just because my 8th grade algebra teacher wasn’t as accurate as an encyclopedia or a published textbook didn’t prevent them from filling the role I rely on ChatGPT to fill now. Edit: also, peer review isn’t a great example of a system that eliminates bs.
- talldayo 2y ago> Just because my 8th grade algebra teacher wasn’t as accurate as an encyclopedia or a published textbook didn’t prevent them from filling the role I rely on ChatGPT to fill now. Sure - but I also cross-referenced my teacher when I was in math class. You know your teacher is wrong because you're also following the steps and showing your work. When your results digress, you cross-reference the steps and determine where you went wrong. Ultimately that's what I fear people won't do with ChatGPT. When they see an equation up on the digital "whiteboard" they only know how to copy it down, not how to double-check the work. This happens already with code boilerplate, but I see it in HN comments when people have ChatGPT write them a nonsense treatise on whatever the topic-du-jour is. You really cannot "learn" much from a system that has no barriers or alarm system when it's outright fabricating things with no basis in reality.
- grayhatter 2y agoImagine telling on yourself like this...
- bloomingkales 2y agoAre you referring to me? What the hell do you mean lol This is the closest thing you are going to get to say it to my face buddy on HN you are gonna get.
- LPisGood 2y agoI wouldn’t say it’s instant. These kinds of models have been out for at least 6 years (depending on if you think BERT, or GPT-2, or whatever is the first). Their capabilities and short comings, at least in a general sense, are pretty well known.
- ctoth 2y agoA Stochastic parrot, you stochastically parrot.
- deleted 2y ago[deleted]
- danielbln 2y agoFor every hype there is the anti-hype, as can be seen in the parent comment. I suppose it's just the way things go, until we've arrived at a more measured place.No, LLMs aren't AGI, not by a long shot. And yes, they are significantly more powerful than Markov chains.