4 ms·
>aphasics are all capable of cognition without language so “language is all you need” is still an incomplete position. (But boy there is that strange fact that
by pixl97 4y ago
>aphasics are all capable of cognition without language so “language is all you need” is still an incomplete position. (But boy there is that strange fact that transformers work for vision although research may be showing that is accidental?)
This is one of these places I hope we aren't trapping ourselves in our own thinking like we did with flying. "It's only flying if you flap your wings" could be thought of one of those trapping in 1900, when it turns out that is but one way of flying, and throwing lots of power at rotating blades is another.
We may be able to create 'intelligence' from text alone, but I do think that it will need input/output methods of divining that truth, hence simulating the IO functions of the animal, whatever that may look like in the end.
- PaulHoule 4y agoThe semantics problem is all about https://en.wikipedia.org/wiki/Symbol_grounding_problem https://en.wikipedia.org/wiki/Symbol_grounding_problem And I’d say there is more than one kind of ‘embodiment’. It sounds trivial to map the word ‘red’ to an area of the RGB color space but if you ask a robot to give you the red ball and you get the red ball didn’t you ground ‘red’? I think the image-language models put language in confrontation with something else and ground it in some respect, you could even say HFRL training ChatGPT causes it to move towards pleasure and away from pain and that’s a very simple kind of experience. For that matter just turning text into database records that can be processed by ordinary software is a useful form of grounding, as would be asking for something and getting it in the mail. ‘Language is all you need’ is a more credible position than it was a year ago.
- pixl97 4y agoJust reading another article on HN where Microsoft is saying GPT-4 is being trained in multimodal mode, so I'm not sure if we're going to have much time to talk about text only models... I guess we see how it pans out really soon.