3 ms·
I was going to say humans do something like hallucinate all the time - we come up with what ifs, fiction and so on. I think the thing is we then hopefully go ba
by tim333 3y ago
I was going to say humans do something like hallucinate all the time - we come up with what ifs, fiction and so on. I think the thing is we then hopefully go back and check if it seems real or made up, which would not necessarily be hard to do in LLMs. Having come up with a fact it could google it to check for example - something I do myself.
It's interesting with the "shape rotator" or physics engine type stuff OpenAI's Sora video thing seems to have picked up a reasonable amount of that.
The current LLMs seem to miss out on a looping thinking aspect as in I could do option A - visualise it - not that wouldn't be good because of some problem - how about option B and so on that we humans call thinking about things. But it seems that could be programmed in.