4 ms·

Let's make this concrete. What in your mind is a specific example of a concrete system with an emergent property, then?

by darawk 4y ago

mjburgess 4y ago
Liquidity is not a property of h2o molecules but it is of water. Liquidity isn't of water without a container/pressure environment. The trajectories of particles of air are underdetermined by their own intrinsic properties so a tornado cannot be reduced to some mere aggregate of them. Emergence is an ontological relationship between properties of objects --- it isn't a mathematical property of a data distribution nor of an approximation function. The very use of the term has crated all this confusion right here. Would anyone who thought NNs were showing emergence be also content to find out that the reason for this 'emergence' was just that in the case of so-called 'emergence' our expectations of performance were changing? Do we call it 'emergence' when we replace estimating data using mean() to estimating with ax+b ? There's definitely an illusion here, but one quite easy to spot if you weren't in the game of peddling illusions.
- aaroninsf 4y ago
  Two observations, There is utility and need for some convention of feature description, for the case of the external behavior of the system being correct, for some domain, despite lack of specific training. It is reasonable for users of such systems to say that the internal states and representation don't matter, so long as the behavior is correct; and in cases like these we will benefit from some consensus on how to talk about such things. Fine with me if some new term is applied. More of interest to me though is that it is not at all clear to me that genuine emergence is not possible through scaling (independent of whether it is in any given existing LLM). Because the optimal (most compact) correct representation for a lot of e.g. language output, is exactly that which benefits from abstraction. What reason is there to believe that the abstractions derived at higher levels (of the network generally but not necessarily, depends on the architecture) do not encode non-linear problem spaces in the world, which are "real" emergence? I.e. if the way some network learns arithmetic is to settle on an internal weighting that performs computation, rather than "memorizing assertions", me, I would call that "emergent." But I'm happy to use some other term should one, er, emerge.
- darawk 4y ago
  > Liquidity is not a property of h2o molecules but it is of water The ability to speak English is not a property of floating points, but it is of certain, very specific large tensors of them. What's the difference? > Emergence is an ontological relationship between properties of objects --- it isn't a mathematical property of a data distribution nor of an approximation function. I don't see a hard distinction between ontological relationships and data distributions. All information is fundamentally statistical. Our access to ontology is forever and always mediated by "data distributions". One could, of course posit that there are fundamental, non-statistical ontological things out there. However, the liquidity of water being an ontological relationship while the English-speaking of GPT not being so is merely a hypothesis, not an objective fact of the universe, at least not as far as I can tell.
mistermann 4y ago
> What in your mind is a specific example of a concrete system with an emergent property, then? Not sure if you're joking, but the brain (and consciousness/mind as an emergent phenomenon) is the classic example. Even better, it is what's causing the fundamental problems in this very conversation, due to the inconsistent manner in which it translates terms into meaning (ie: "emergent", "is"), typically not realizing[1] that meaning and reality are similar to the speed of light in that their appearances[2] vary depending upon the frame of reference of the observer. I am fairly optimistic that AI is going to "force humanity's cultural hands" such that we will eventually have to grapple with this long known but rarely discussed phenomenon. Though, I anticipate censorship, propaganda, and consciousness will play heavy roles in such discussions and screw everything up, as is usually the case with fundamentally important ideas. [1] During realtime cognition, regardless of whether substantial abstract knowledge is in the person's possession. [2] And maybe even the things themselves, depending on how (or from where) you look at it - I am still undecided on this.

Let's make this concrete. What in your mind is a specific example of a concrete system with an emergent property, then?

by darawk 4y ago

Let's make this concrete. What in your mind is a specific example of a concrete system with an emergent property, then?

Liquidity is not a property of h2o molecules but it is of water. Liquidity isn't of water without a container/pressure environment. The trajectories of particles of air are underdetermined by their own intrinsic properties so a tornado cannot be reduced to some mere aggregate of them. Emergence is an ontological relationship between properties of objects --- it isn't a mathematical property of a data distribution nor of an approximation function. The very use of the term has crated all this confusion right here. Would anyone who thought NNs were showing emergence be also content to find out that the reason for this 'emergence' was just that in the case of so-called 'emergence' our expectations of performance were changing? Do we call it 'emergence' when we replace estimating data using mean() to estimating with ax+b ? There's definitely an illusion here, but one quite easy to spot if you weren't in the game of peddling illusions.

aaroninsf 4y ago
Two observations, There is utility and need for some convention of feature description, for the case of the external behavior of the system being correct, for some domain, despite lack of specific training. It is reasonable for users of such systems to say that the internal states and representation don't matter, so long as the behavior is correct; and in cases like these we will benefit from some consensus on how to talk about such things. Fine with me if some new term is applied. More of interest to me though is that it is not at all clear to me that genuine emergence is not possible through scaling (independent of whether it is in any given existing LLM). Because the optimal (most compact) correct representation for a lot of e.g. language output, is exactly that which benefits from abstraction. What reason is there to believe that the abstractions derived at higher levels (of the network generally but not necessarily, depends on the architecture) do not encode non-linear problem spaces in the world, which are "real" emergence? I.e. if the way some network learns arithmetic is to settle on an internal weighting that performs computation, rather than "memorizing assertions", me, I would call that "emergent." But I'm happy to use some other term should one, er, emerge.
darawk 4y ago
> Liquidity is not a property of h2o molecules but it is of water The ability to speak English is not a property of floating points, but it is of certain, very specific large tensors of them. What's the difference? > Emergence is an ontological relationship between properties of objects --- it isn't a mathematical property of a data distribution nor of an approximation function. I don't see a hard distinction between ontological relationships and data distributions. All information is fundamentally statistical. Our access to ontology is forever and always mediated by "data distributions". One could, of course posit that there are fundamental, non-statistical ontological things out there. However, the liquidity of water being an ontological relationship while the English-speaking of GPT not being so is merely a hypothesis, not an objective fact of the universe, at least not as far as I can tell.

mistermann 4y ago

> What in your mind is a specific example of a concrete system with an emergent property, then? Not sure if you're joking, but the brain (and consciousness/mind as an emergent phenomenon) is the classic example. Even better, it is what's causing the fundamental problems in this very conversation, due to the inconsistent manner in which it translates terms into meaning (ie: "emergent", "is"), typically not realizing[1] that meaning and reality are similar to the speed of light in that their appearances[2] vary depending upon the frame of reference of the observer. I am fairly optimistic that AI is going to "force humanity's cultural hands" such that we will eventually have to grapple with this long known but rarely discussed phenomenon. Though, I anticipate censorship, propaganda, and consciousness will play heavy roles in such discussions and screw everything up, as is usually the case with fundamentally important ideas. [1] During realtime cognition, regardless of whether substantial abstract knowledge is in the person's possession. [2] And maybe even the things themselves, depending on how (or from where) you look at it - I am still undecided on this.