4 ms·
Is 'understanding' it is root not an efficient compression of knowledge. We have understanding of gravity, as Newton's laws explain the behaviour of everything
by hyperman1 7y ago
Is 'understanding' it is root not an efficient compression of knowledge.
We have understanding of gravity, as Newton's laws explain the behaviour of everything that falls to anything else. That's compression: You don't need a long list of measurements of falling things, you just need a much shorter list of starting conditions. Newtons laws will then decompress the long list of measurements from it.
So what does it mean for protein folding? We need more compression so the knowledge is understandable on the human scale? Or AI needs less compression, so it is reasoning in a better way for this problem. Isn't that just a more abstract way for saying AI is smarter than we are.
- sametmax 7y agoIt is. But it's also more. If I give you a list of all unix commands and you don't understand them, you won't go far.
- hyperman1 7y agoUnderstanding as compression would mean that you look at a function with arguments (unix command,input file) and result output file. The size of this function's implementation gives your understanding, smaller being better understanding If you have no understanding at all, the only possible implementation is an infinite lookup table. When you start understanding commands better, you can implement parts better.
- abdullahkhalids 7y agoThere is definitely more to understanding than compression of knowledge. Here is one thing. Knowledge is often represented as graph, where the links represent facts that are related in some way - perhaps causally, perhaps because they are analogs in two different scenarios etc. Understanding would include your ability to quickly traverse this graph so you can point out connections between facts which are more than one link apart.
- erikpukinskis 7y agoWouldn’t more compressed graphs generally be faster to traverse?
- abdullahkhalids 7y agoDepends on how you compress them. Some representation are good for storing, others good for processing in different ways.
- TeMPOraL 7y agoSeems to match real-life thinking, too. For extreme case, see memorization: you learn a set of nodes in a graph, probably highly compressed through application of whatever tricks you use to quickly memorize and recall information. But by default, you learn almost no connections between those nodes, you can't really reason from the material you memorized. Building these connections requires further mental effort.
- hyperman1 7y agoI can think of multiple graphs representing the same knowledge, some smaller than others as irrelevant nodes are pruned, paths are shorter, etc.. The smaller ones encode that same knowledge with better understanding.
- abdullahkhalids 7y agoLet's consider understanding a mathematical theory - say linear algebra. In principle, the entirety of the knowledge of LA is contained in it's axioms and the standard rules of propositional logic (i.e. can be compressed into them). If you just know those, you can recover any theorem or statement of LA. But this is not how human understanding operates at all. Usually one understands LA when one has memorized many different theorems of LA, have perhaps memorized how to derive some from others, or even the same theorem in several different ways. That doesn't even begin to cover establishing links between LA and other branches of mathematics, all of which a proficient mathematician memorizes individually, and memorizes connections between the links. The mathematicians mental knowledge graph is compressed, but not that much.