4 ms·
Not just an abstraction barrier, but also a working memory limit of maximum 7-8 objects at a time. We're limited in more than one way in how much we can underst
by visarga 10y ago
Not just an abstraction barrier, but also a working memory limit of maximum 7-8 objects at a time. We're limited in more than one way in how much we can understand.
If we ever discover AGI, I think we will begin a new discipline, called "AGI studies" where humans try to understand what it discovers, to keep up. But the hard part would be to develop the most efficient concepts in order to understand even what it has to teach us. How do you communicate with an intelligence vastly superior to yours? Maybe the AGI will also develop the concepts and language necessary to communicate its findings to us.
- ori_b 10y ago> Maybe the AGI will also develop the concepts and language necessary to communicate its findings to us. It will, because without that, humans will just shut down the "machine that only speaks gibberish". Effectively communication with humans is a survival requirement.
- deleted 10y ago[deleted]
- Florin_Andrei 10y agoThe question is whether the limits mentioned above are due to constraints in the processing power of the "human CPU", or are limits inherent to any approach based on logic. In other words, does reason itself, no matter how fast or large, have limits? Results such as the incompleteness theorem, Godel's work, etc seem to suggest that logic itself has limits, along with everything derived from it and/or built on top of it. In other words, even an ASI, even if you converted the whole known universe to "computronium" - it would not do better against those limits than evolution-shaped human brains. Reason itself seems to have an event horizon. The fact that the human brain has very clear and obvious processing power limitations is a separate issue.
- deleted 10y ago[deleted]
- internaut 10y agoIt is possible there is a form of understanding that goes over and above what we'll loosely call reason? I don't mean woo-like supernatural or mysticism. Let's use an analogy. We have instincts and reason. Instincts are quick but flawed, reason is slow but surer. Reason is to X what Instincts are to reason. What if there existed X metacognition and above reason itself? Suppose, for example with the assistance of an AI (capable of seeing larger pattern a human cannot) in conjunction with brain altering drugs to, crudely, give you a hit of comprehension/meaning (as a reward) when you successfully pattern matched with the assistance of the AI. That to me seems like much more than thinking from 1st principals. It would be something closer to seeing than thinking sequentially.
- Florin_Andrei 10y agoIt's very hard to even verbalize your intuitions on this topic without veering into metaphysics. But let me give it a try. Provided there's a 4th layer on top of the triad matter/energy/information - then yes, it would be doable. Our bodies exist in the same way rocks do - just like dead matter. On top of that, there's the "meta" level of life, which is just matter playing with energy. It can do things that dead matter alone cannot do. On top of that, there's the "meta" level of mind, which is just matter/energy (i.e. life) playing with information. It can do things that the previous two levels cannot do. We are organized on 3 successive layers (body / life / mind) because the universe could be thought of as structured on 3 layers: matter / energy / information (we have started to figure out the equivalences between these layers recently). So mind is what evolution put forward to master the domain of information. Everything that could be done with information, the mind could probably do, it's just a question of how fast. So if there are any limitations to logic (and therefore to reason), it's likely that these come from the way the information meta-layer of the universe works. If you want to see these limitations removed, you better hope there's a 4th meta-layer (in philosophy I guess you could call it a 4th principle) of the universe that can do things that the currently known 3 layers cannot do. But then that 4th meta-layer would have to somehow become embodied, either naturally (evolution) or artificially (technology). However, it's hard to figure out how 3-layer beings like us could even begin to approach building something like that. It would be like a worm trying to understand quantum electrodynamics. All of the above is just one giant pile of assumptions floating on thin air. > It would be something closer to seeing than thinking sequentially. Or closer to being what is called truth (that which is), rather than even "seeing". Are we getting kicked out of here yet? :)
- deleted 10y ago[deleted]