9 ms·
Absolutely agree. This model isn't about basemark chasing or being a better code generator; it's entirely explicitly focused on pushing prior results into the
by aaroninsf 2y ago
Absolutely agree.
This model isn't about basemark chasing or being a better code generator; it's entirely explicitly focused on pushing prior results into the frame of multi-modal interaction.
It's still a WIP, most of the videos show awkwardness where its capacity to understand the "flow" of human speech is still vestigial. It doesn't understand how humans pause and give one another space for such pauses yet.
But it has some indeed magic ability to share a deictic frame of reference.
I have been waiting for this specific advance, because it is going to significantly quiet the "stochastic parrot" line of wilfully-myopic criticism.
It is very hard to make blustery claims about "glorified Markov token generation" when using language in a way that requires both a shared world model and an understanding of interlocutor intent, focus, etc.
This is edging closer to the moment when it becomes very hard to argue that system does not have some form of self-model and a world model within which self, other, and other objects and environments exist with inferred and explicit relationships.
This is just the beginning. It will be very interesting to see how strong its current abilities are in this domain; it's one thing to have object classification—another thing entirely to infer "scripts plans goals..." and things like intent, and, deixis. E.g. how well does it now understand "us" and "them" and "this" vs "that"?
Exciting times. Scary times. Yee hawwwww.
- DonHopkins 2y ago>But it has some indeed magic ability to share a deictic frame of reference. They really Put That There! https://www.youtube.com/watch?v=RyBEUyEtxQo https://www.youtube.com/watch?v=RyBEUyEtxQo Oh, shit.
- razodactyl 2y agoIn my view, this was in response to the machine being colourblind haha
- nicklecompte 2y agoWhat part of this makes you think GPT-4 suddenly developed a world model? I find this comment ridiculous and bizarre. Do you seriously think snappy response time + fake emotions is an indicator of intelligence? It seems like you are just getting excited and throwing out a bunch of words without even pretending to explain yourself: > using language in a way that requires both a shared world model Where? What example of GPT-4o requires a shared world model? The customer support example? The reason GPT-4 does not have any meaningful world model (in the sense that rats have meaningful world models) is that it freely believes contradictory facts without being confused, freely confabulates without having brain damage, and it has no real understanding of quantity or causality. Nothing in GPT-4o fixes that, and gpt2-chatbot certainly had the same problems with hallucinations and failing the same pigeon-level math problems that all other GPTs fail.
- famouswaffles 2y agoOne of the most interesting things about the advent of LLMs is people bringing out all sorts of "reasons" GPT doesn't have true 'insert property' but all those reasons freely occur in humans as well >that it freely believes contradictory facts without being confused, Humans do this. You do this. I guess you don't have a meaningful world model. >freely confabulates without having brain damage Humans do this >and it has no real understanding of quantity or causality. Well this one is just wrong.
- HeatrayEnjoyer 2y agoSo many even here on HN have a near-religious belief that intelligence is unique to humans and animals, and somehow a fundamental phenomenon that cannot ever be created using other materials.
- dvaun 2y agoIt's a defensive response to an emerging threat to stability and current social tiers.
- alienicecream 2y ago[dead]
- idontpost 2y ago[dead]
- joquarky 2y agoIt reminds me of the geocentric mindset.
- spuz 2y agoI agree. The interesting lesson I take from the seemingly strong capabilities of LLMs is not how smart they are but how dumb we are. I don't think LLMs are anywhere near as smart as humans yet, but it feels each new advance is bringing the finish line closer rather than the other way round.