4 ms·
At this point it wouldn't surprise me if it turns out humans don't have a consistent model of the world and our knowledge; if the part of me which sees a ball i
by jodrellblank 3y ago
At this point it wouldn't surprise me if it turns out humans don't have a consistent model of the world and our knowledge; if the part of me which sees a ball incoming and moves to catch it is a separate mental model of physics to the part which predicts where I want a ball to go and moves to throw it, and if they are separate again to the part which uses language to explain the ball catch/throw, and separate again to the part which could once upon a time do basic math modelling of a ball following a parabola. Not one consistent worldview but several brain areas having differing "physical models" for different uses, piled up higgledy piggledy into one basically workable creature; isn't that how biology does lots of things? Retina with optic nerve coming out of the front instead of the back, frontal lobes layered on much older brain parts, nerves going from brain to neck via a loop around the hearts, etc. etc.
We talk as if humans build a single coherent model of the world and LLMs don't, but humans can have conflicting and overlapping beliefs; would it be so strange if we are actually lots of individual memorised patterns layered and overlapped and bodged into a somewhat coherent worldview? If LLMs are closer to the way humans think than we want to admit? We're fine with apples falling from trees, but even uneducated people deal with birds, aircraft, clouds, smoke, and the Moon not falling down, they don't go into an "incoherent physical model panic state" until they've learned about buoyancy or air pressure or orbits.
And we don't default to our spoken and written languages having simple rules as you might expect if we were pushing internally for simple single models; instead we're fine with exceptions, strange plurals, strong verbs, odd pronounciations, we just learn them. They're only annoying when learning a foreign language and seeing it as a chore, natively we try to extract some pattern and layer on exceptions all over the place.
- steveBK123 3y agoI think the challenge with LLMs in their current form is that they have the eloquent writing skills of an adult, but the logical reasoning skills of a 5 year old. Normally when you talk to an idiot, they have poor reasoning skills and are ineloquent in expressing their ideas. Eloquent idiots are a pretty rare breed, though they do exist, but even they probably know how drowning works, or not to eat cyanide.