4 ms·
You say that but we have models of meaning in humans too. You can put people in an fMRI and ask them to think "car". You can ask someone to think of objects
by psychphysic 4y ago
You say that but we have models of meaning in humans too.
You can put people in an fMRI and ask them to think "car".
You can ask someone to think of objects and detect when they think "car".
What happened there pairing a bunch of tensors to meanings and matching them.
We can do something similar with embeddings.
To be clear I don't intend to give the impression that these LLMs are doing something miraculous. Just that we are increasingly peeling back the veil of how brains think.
- wizzwizz4 4y ago> You can put people in an fMRI and ask them to think "car". I don't know about other people, but when I think “car” really hard, I can feel the muscles in my throat adjust slightly to match the sound of the word “car”. Perhaps that sort of thing is what the MRI machines is picking up, rather than being able to pick up some kind of "internal representation" of car.
- psychphysic 4y agoIn fact it also picks up the parts of your brain to do with driving (if you're a driver). Maybe also the part to do with the smell of fuel in me, but not you. It'll also light up in the parts of my brain to do with reading, writing, hearing the word in the languages I speak. What does car mean to me if it doesn't connect to all the concepts that relate to cars?
- Zircom 4y agoMaybe they should do the same study on people that lack an internal monologue to see if they have the same results.