4 ms·
> As someone working in AI research Being in the tail end of my PhD, I want to second this sentiment. I'm not even bullish on AGI (more specifically HLI) in 50
by godelski 4y ago
> As someone working in AI research
Being in the tail end of my PhD, I want to second this sentiment. I'm not even bullish on AGI (more specifically HLI) in 50 years. Scale will only take you so far and we have to move past frequentism. Hell, causality research still isn't that popular but is quite important for intelligence.
I think people (especially tech enthusiasts) are getting caught in the gullibility gap.
- ta988 4y agoYes we are going back to symbolism, , ontologies and causality. Which is a good and healthy sign. It was abandonned the same way neural networks were at some point. Now that it becomes practical at scale, we can combine them all.
- thewarrior 4y agoI know it maybe too much to ask but as a noob to this field I’d love to hear more about why AGI is not feasible even in 50 years.
- version_five 4y agoI've seen a few posts here asking why it isn't possible. Research doesn't work like that, you can't just imagine something is possible and demand reasons why it isn't. How is it possible? It feels a bit like a lot of these fringe science things (electromagnetic fields causing harm etc) where people's argument is that nobody's shown it isn't true. Well if it's true, propose a mechanism and study it. You're not really doing research if you just make up a conclusion and use the fact that it can't be definitively refuted as evidence for it
- godelski 4y agoYeah this is a good point. I've been taking the bearish position of HLI here but that doesn't mean I don't think HLI is impossible. I very much do think it is possible (I'm not sure there are many researchers who think it is impossible) but just how close we are. But we don't even have good definitions, so really this is just laymen being privy to expert arguments. I also think there's this naive belief that complex topics can be distilled to laymen terms while maintaining accuracy. That's definitely not true here, as even our "in-group" doesn't have a consensus. But that's cutting edge research for you.
- another-dave 4y agoIn fairness to the parent, research doesn't work that why, but they're not conducting research. "What are the remaining unknowns that would need to be solved to do X and why are they difficult?" is valid question to ask experts when trying to further your own understanding.
- godelski 4y agoSure. It is rather complex to be honest but I'll do my best to give a high level abstract. I should first off explain that there's no clear definition of intelligence. You might see some of my other comments use the term HLI, which is Human Level Intelligence. It is a term gaining in popularity due to this difficult to define definition and allows for more a porn like definition -- I know it when I see it. Philosophers, psychologists, neuroscientists, and many others have been contemplating the definition of intelligence for centuries and we're still not quite there. But we do have some good ideas. One of the important aspects is the ability to draw causal relationships. This is something you'll find state of the art (SOTA) text to image (T2I) generators fail at. The problem is that these models learn through a frequency based relationship with the data. While we can often get the desired outcome through significant prompt engineering it still demonstrates a lack of the algorithm really understanding language. The famous example is "horse riding an astronaut." Without prompt engineering the T2I models will always produce an astronaut riding a horse. This is likely due to the frequency of that relationship (people are always on horses and not the other way around). Of course, there are others in the field that argue that the algorithms can learn this through enough data, model scale, and the right architecture. But this also isn't how humans learn and so we do know that if this does create intelligence it might look very different ("If a lion could talk I wouldn't be able to understand it"). Obviously I'm in the other camp, but let's recognize that this camp does exist (we have no facts, so there's opinions). I think Chomsky makes a good point: our large language models have not taught us anything meaningful about language. Gary Marcus might be another person to look into as he writes a lot on his blogs and there's a podcast I like called Machine Learning Street Talk (they interview both Marcus and Chomsky but also interview people that have the opposite opinion). So another thing, is that machines haven't shown really good generalization, abstraction, or really inference. You can tell a human a pretty fictitious scenario and we're really good at producing those images. Think of all the fake scenarios you go through while in the shower or waiting to fall asleep. This is an important aspect of human intelligence as it helps train us. But also, we have a lot of instincts and a lot of knowledge embedded in our genetics (as does every other animal). So we're learning a lot more than what we can view within our limited lifetimes (of course our intelligence also has problems). Maybe a good example of abstraction is "what is a chair." There's a whole discussion about embodiment (having a body) and how language like this may not be able to be captured in the abstract manner without a body since a chair is essentially anything that you can sit on. I feel like I've ranted and may have written a mess of a lot of different things haha. But I hope this helps. I'll try to answer more and I'm sure others will lay out their opinions. Hopefully we can see a good breadth of opinions and discussion here. Honestly, no one knows the answers.
- thfuran 4y agoThey didn't say it's not possible within 50 years, they said they weren't expecting it to happen in that timeframe, and that's a very different sort of claim.
- sigmoid10 4y agoAs an AI researcher myself I can definitely see why people used to have these sentiments, but I also have to point out how the big papers of the last ~12 months or so have changed the landscape. Especially multi-modal models like Gato. To my surprise, a lot of people (even inside the community) still tend to put human intelligence on some sort of pedestal, but I believe once a system (or host of systems) achieves a sufficient level of multi-modality, these same people will no longer be able to tell human and machine intelligence apart - and in the end that is the only thing that counts, since we lack a rigorous definition of "understanding" or consciousness as a whole. Transformers are certainly going to become even more general purpose in the future and I'm sure we haven't even seen close to what's possible with RL. Regarding the AGI timescale, I'm a bit more bullish. Not Elon-type "possible end-all singularity in 5 years" but more Carmack-like "learning disabled toddler running on 10k+ GPUs by the end of the decade." Whether RL+transformers will be able to go all the way there is impossible to tell right now, but if I was starting an AGI company today that's definitely the path I would pursue.
- godelski 4y agoI'm not sure Gato actually demonstrates intelligence. It definitely does demonstrate the ability to perform a wide variety of tasks, but I don't think that is actually intelligence. Gato has yet to demonstrate that it understands things. I do think it is easy to fall prone to the gullibility gap (and also take too strong of an opposing view, which I may be victim to).
- labrador 4y ago> gullibility gap Search turns up very little except a book by a Christian author. Could you define what you mean by gullibility gap?
- version_five 4y agoIt's coined in context.
- labrador 4y agoI don't see it. Did they mean "uncanny valley"?
- godelski 4y agoKinda. The gullibility gap more refers to the fact that it is really easy to believe the machines are smarter than they are because they can perform tasks that nothing but humans can do. With the exception of maybe parrots there's no other creatures that can talk so we associate this with intelligence. But I think it is rather naive to believe that the ability to string together reasonable sounding text is actually intelligence. There has yet to be a demonstration of these algorithms actually understanding things.
- Roland3 4y agoWhat sort of demonstration do you have in mind?
- godelski 4y agoReally I'd say it is coined by Gary Marcus. At least that's who I first heard discuss it.
- evrydayhustling 4y agoThis is a classic case of scope creep caused by underspecified scope (evidenced by how little HLI improves the non-definition of AGI). If humans accurately exhibited causal reasoning in any but the most mind-numbingly obvious conditions we would be living in a very different world!
- colinsane 4y ago> Hell, causality research still isn't that popular but is quite important for intelligence. what are the esteemed epistemological frameworks in the AGI space? from the outside looking in, i see CNNs and lots of correlation-based approaches: it looks like the field settled on consequentialism. is that not the case?
- deleted 4y ago[deleted]
- martindbp 4y ago> Being in the tail end of my PhD That doesn't really qualify you to make these anti-predictions any more than tens of thousands of other people working in this field. There's also this phenomenon where experts close to a problem are worse at predicting the future because they are so intimately familiar with the problems that they can't see the forest for the trees. To me there is one major signal that AGI is much closer than 50 years away and that is the breakthrough with Transformers. Now we have a general purpose architecture for predicting the future that works really well, which is a key component in the brain (cortical columns). Clearly we're still at the early stages, but 50 years is a loooong time. 50 years ago we didn't even have the Altair 8800.
- K0balt 4y agoScale isn’t the problem. Very simple organisms display general intelligence. General intelligence is rampant in the insect world. It’s something along the lines of a repl vs compiled language paradigm shift.
- Melting_Harps 4y ago> I think people (especially tech enthusiasts) are getting caught in the gullibility gap. I think it's that coupled with inserting their own often fanciful projections to fill the void and gaps between the lack of understanding how the mechanics works. Here is a good example of influencers laboring under this narrative [0] and a glimpse as to why it's so effective and pervasive. I'm conflicted, because I think this is precisely what keeps many Corps and VCs throwing money into this tech thinking it's just right around the corner, as, I'm also studying AI and ML, but I also realize how implausible AGI is in my lifetime given where we are and how narrow parameters these algos function in to yield some degree of accuracy and more specifically how many errors there are to do so as it's just part of the process--learning how gradient descent works was pretty eye opening. The Marketing has made many people not just fall into a gullibility gap as they make it seem like some sort of black magic, when it's really just statistics fed with immense amounts of specific data, but influncers make it seem like it's capable of ending the World (Elon) when in reality people should be more worried about big tech's capability at aggregating data points from info people willfully post online to exclude you or cluster you into a certain group because of your use of free apps and selling it the highest bidder which are tied to your real ID. Or the algos with weights (biases) that are used and bundled into outsourced/automated HR solutions. 0: https://youtu.be/jdIyNMkusLE?t=1268 https://youtu.be/jdIyNMkusLE?t=1268
- stu_ 4y agoI don't think folks in academia are anywhere near the cutting edge on AGI. It's not a field that is advanced by things like particle accelerators as you might find in physics, that some unis are famous for. Look at the work result of folks like engineers at Google - state of the art in AI and driving most of the trends in AGI. Academic opinions are shot down quite quickly there, PhD hiring is mostly frowned on, even in teams working on AGI related tech. It might be expected that PhD experience provides surprising little insight here unfortunately. Academic smugness is not something that should be offered as part of an opinion- just like many computer science related concepts, progress moves so quickly in these topics that by the time academics reach and start to iterate on concepts, companies have already moved very far beyond. This isn't intended to be condescending to academics, just real life experience I've had working closely with both crowds and seeing this firsthand. It's a very palpable thing in industry, an Academic gives an opinion on AGI and engineers roll their eyes - since Academic perspectives are currently so useless or out of date for any current, meaningful progress.