3 ms·
I think they're more than that, but I also think they're bullshit generators. Informed bullshit generators even. Which is quite useful to do some tasks: writin
by orwin 4y ago
I think they're more than that, but I also think they're bullshit generators. Informed bullshit generators even.
Which is quite useful to do some tasks: writing fiction (it now wrote at least 6 characters in multiple rpg campaigns I participate in) and probably others (I used it to write tests data, but in fine I had to revalidate it by hand. Could do better.)
I do not see LLMs be more than that in the near future though. More informed, more accurate bullshit generators? Yes probably.
And I'm not saying it isn't impressive and very close to human behavior. I still think we're missing a part in our models though, and until we find it, breakthrough will be limited to improvements on accuracy and information.
- erwald 4y agoThey definitely hallucinate a lot too. But they also seem to do things genuinely like reasoning, e.g. they seem to contain and use "cognitive" world models, and seem to be capable of learning fully general algorithms. Beyond that, many intellectual capabilities are also useful for successful bullshitting, so even if we can confidently say that that's all they do (in some sense), that doesn't mean they don't also do something-like-human-reasoning etc.
- orwin 4y agoThat's basically what i was saying. It's close to human capability. I don't really know how to explain it, but to me we have at least two kind of reasoning, swallow and deep. LLMs could well be capable of the first.
- JohnAaronNelson 4y agoCan you explain to me how choosing “the most likely next word” is reasoning? Can there be reasoning without language?