4 ms·
Have you actually used any of these products? GPT et al are perfectly capable of taking knowledge from any one domain and applying it towards the solution of an
by adastra22 4y ago
Have you actually used any of these products? GPT et al are perfectly capable of taking knowledge from any one domain and applying it towards the solution of any other problem domain, through various kinds of data abstraction, reasoning by analogy, and other techniques similar to what humans do. It makes plenty of goofups along the way, just like humans do. But if your requirement is that it performs absolutely perfectly in new domains without making any mistake or needing any supervision... well that is certainly a requirement no human could ever meet, either.
- RhysU 4y agoTo be completely ridiculous, we'll have AGI when it can convince a human to mate with it over any other human followed by raising its offspring to a successful adulthood. This is the game we're all playing.
- pixl97 4y agoParasites are also lifeforms. It doesn't have to convince you to breed, it has to convince you to keep it plugged in and feeding ever increasing amounts or computing power. In theory GPT is there with the right prompt.
- barking_biscuit 4y ago>It doesn't have to convince you to breed, it has to convince you to keep it plugged in and feeding ever increasing amounts or computing power. It's already succeeding at that.
- JohnFen 4y ago> through various kinds of data abstraction, reasoning by analogy, and other techniques similar to what humans do. No, that's exactly not how LLMs work. They are extremely good at predicting what sentences resemble the sentences in their training data and creating those. That's all. People are getting tripped up because they are seeing legitimate intelligence in the output from these systems -- but that intelligence was in the people who wrote the texts that it was trained with, not in the LLM.
- wokwokwok 4y agoI feel like there are two parallel discourses going on here, and it's crazy. On the one hand, we have LLM, and people arguing that they are simply memorizing the internet and what you're getting is a predictive regurgitation from what actual people have said. On the other hand, you have AI Art, and people arguing that it's not just copy-pasting the images it's recognized, and it's actually generating novel outputs by learning 'how to draw'. Do you see a commonality? It's that people are arguing whatever happens to be convenient for them. If a model can generate human-like responses, and it has a large input token size that effectively allows it to maintain a 'memory' by sticking the history in as the input rather than being a one-shot text generator... Really. What is the difference between that and AGI? Does your AGI definition mean you have to have demonstrated understanding of the underlying representations that are put in as text? Does it have to be error free? What fundamental aspect of probabilistic text generation means that it can't be AGI? ...because, it seems to me that it's incredibly convenient to define AGI as something that can't be represented by a LLM, when all you have really is a probabilistic output generator, and a model that currently doesn't do anything interesting. ...and it doesn't. It's not AGI. Right now; but your comment suggests that because of the technical process that the output is generated by that LLMs are fundamentally unable to produce AGI; and I think that's not correct. The technical process is not relevant; it's simply that these models are not sophisticated enough to really be considered AGI. ...but a 5000 billion param model with a billion character token size? I dunno. I think it might start looking pretty hard to argue about.
- highspeedbus 4y agoI have the same sentiment. To me, there's two kinds of groups in most recent discussions about GPT: those who don't understand the underlying functionality at all and those who think they deeply understand it down to its bits. The second group seems to be very stubborn in downplaying GPT et al capabilities. What's curious is that, for the first time in history of AI field, the source of general amazement is coming straight from AI responses, rather than some news or corporate announcement about how the thing works or what it will be able to do for you.
- madmax96 4y ago
- andrepd 4y agoNope, they are good at prete ding they do. Ask it something that can't be googled in 30s and you will see this. I'm skeptical you can simply scale up this approach to full AGI.