3 ms·

> The point of intelligence is to base statements on an investigative refined ontology This is a very narrow conception of intelligence as kilgnad pointed out,

> The point of intelligence is to base statements on an investigative refined ontology This is a very narrow conception of intelligence as kilgnad pointed out, but nevermind that. The most interesting word you used is "investigative". The most surprising thing about LLMs -- surprising nearly all researchers -- is that merely reading the internet (observation) is enough to build a model of the world. Many people thought that investigation/experimentation by an embodied agent was necessary to do so. I now think that experimentation is much more efficient, but enough observation can be sufficient. For example imagine you look over someone's shoulder while they spend years going through school learning mathematics. Difficult but not impossible to learn from their exercises and mistakes. On the other hand the world model contained in LLMs is still very deficient in many basic things such as understanding consequences of simple physical interactions, which aren't captured by online texts.

mdp2021 4y ago
(Sorry for the delay.) > narrow conception It is there to place constraints. Like when a job description for a teacher included "The incumbent shall refrain from false statements, and shall be able to produce relevant, important true statements from creatively reasoning over solid ideas and logic". I mention "operational relevance" because "we have already invented cats" (i.e. the need remains that of problem solvers). > enough to build a model of the world Sure - and that is very interesting -, but a point of "Intelligence vs acquisition" is that of "Judgement vs prejudice". You get a world model, but if such model is not under active refinement through critical processing (in the sense of criticizing its elements - the ideas), its contents will be "stale" and unreliable. An Intelligent agent verifies its statements upon production (which is part of the refinement process). It is "mission critical". > understanding consequences of simple physical interactions That reminds of the definition from the late Prof. Patrick Winston, "Intelligence is to know what would happen if you ran holding a bucket of gravel, even though you never did that".

mdp2021 4y ago

(Sorry for the delay.) > narrow conception It is there to place constraints. Like when a job description for a teacher included "The incumbent shall refrain from false statements, and shall be able to produce relevant, important true statements from creatively reasoning over solid ideas and logic". I mention "operational relevance" because "we have already invented cats" (i.e. the need remains that of problem solvers). > enough to build a model of the world Sure - and that is very interesting -, but a point of "Intelligence vs acquisition" is that of "Judgement vs prejudice". You get a world model, but if such model is not under active refinement through critical processing (in the sense of criticizing its elements - the ideas), its contents will be "stale" and unreliable. An Intelligent agent verifies its statements upon production (which is part of the refinement process). It is "mission critical". > understanding consequences of simple physical interactions That reminds of the definition from the late Prof. Patrick Winston, "Intelligence is to know what would happen if you ran holding a bucket of gravel, even though you never did that".