3 ms·
Why is it bizarre to consider the limitations inherent in the input data on which the model is trained? Sure the thing is limited, the study is demonstration o
by joe_the_user 3y ago
Why is it bizarre to consider the limitations inherent in the input data on which the model is trained?
Sure the thing is limited, the study is demonstration of this (and general purpose abilities have been claimed for LLMs at various point).
I was pushing back against the "it's like a blind person" anthropomorphizing argument [edit: especially the assumption these things learn through experience and reflection which the parent also makes]. Maybe if the thing "had eyes", it could learn spatial information and maybe it couldn't (though it would take a lot of work to make that metaphor meaningful). The thing certainly doesn't learn text in the fashion that human learns speech since humans don't digest the entire Internet before they can speak.
- pixl97 3y agoI'd recommend looking up model grounding by multi-modal training. Seemingly models improve as you add more modes.
- daveguy 3y agoThe study did include a multimodal model. Apparently it doesn't improve abstract reasoning capability, because according to the article the multimodal gpt4 did just as dismally as the text-only gpt4. This was surprising to me, as I would have expected an improvement with a model that did include spatial relationships.