2 ms·
> AI models we have now, the intelligence ... an emergent property Exception raised on several terms. «AI models»: they are built (roughly) on the "problem" (
by mdp2021 4y ago
> AI models we have now, the intelligence ... an emergent property
Exception raised on several terms.
«AI models»: they are built (roughly) on the "problem" (task) of "reply something relevant and convincing". Which satisfies the technical contextual definition of "intelligence" ("solving a problem") but not the intrinsic one ("say something through intelligence").
«emergent»: the specific "intelligence" was already there in the training data - it does not emerge but it is repeated.
> to what extent is the growth in 2023-style AI capped by the availability of training data
An intelligent entity does not need to read the whole of past intellectual production: there is no cap. Fed data is already overly plentiful. It does achieve "relevant and convincing", does not it? It is the jump to "reliable" (and beyond) that is missing.
- idlewords 4y agoEmergent in this case means that the property is not present in the individual elements but shows up in the whole. There was no hint ahead of time that (for example) training neural networks on hundreds of billions of images would create qualitatively different results than training on millions, but here we are.