3 ms·
I'm not there yet but as the responses get better and better, it would be hard to say it has no world model at all. Can it explain why the diamond is on the bed
by karmakaze 4y ago
I'm not there yet but as the responses get better and better, it would be hard to say it has no world model at all. Can it explain why the diamond is on the bed, and have it say due to gravity, which is a curvature in space-time?
Basically I'm asking "what is a world model?". It's connecting pieces of information and inferences and being able to substitute by way of analogy concrete instances into the symbolic/conceptual slots. As it gets better at connecting the dots and being able to figure out which connections are strong vs contextual/weak it should be able to parrot human intelligence precisely. I'm not using 'parrot' derogatively here either, but rather that human intelligence could also be just that.
I mean some folks say the machine can't reason, but machines can be very good at logical reasoning when provided clean input.
I'll be sold when the responses start to show originality that can't be synthesized by substitution and juxtaposition of former input, which could well happen in my lifetime. I used to think similarly before AlphaGo that our machines can't be creative beyond the level of humans in an exceptionally large search space, but that day has passed.
- famouswaffles 4y agoWell language models can generate novel and functioning protein structures that adhere to a specified function. https://www.researchgate.net/publication/367453911_Large_language_models_generate_functional_protein_sequences_across_diverse_families https://www.researchgate.net/publication/367453911_Large_lan... Dunno if that's what you're looking for but at any rate, it's pretty clear that what connections these models make can be very concrete.
- karmakaze 4y agoYes this is a great example of what it can do with good input. What seems to be missing is grading the input, like a PageRank for ingested information sources. Ultimately it could develop its own pageranking senses.