3 ms·
The main "feature" of LLM is it has world-knowledge and can create plausible arguments for just about everything. "Nothing is true, Anything is possible" Which
by softwaredoug 10mo ago
The main "feature" of LLM is it has world-knowledge and can create plausible arguments for just about everything. "Nothing is true, Anything is possible"
Which is a fascinating thing to think about epistemologically. Internally consistent knowledge of the LLM somehow can be used to create an argument for nearly anything. We humans think our cultural norms and truths are very special, that they're "obvious". But an LLM can create a fully formed counterfactual universe that sounds? is? just as plausible.
- ludicrousdispla 10mo agoAn LLM doesn't have any knowledge, it's just a masterful mix-tape machine.
- dgoodell 10mo agoWhat makes you think an LLM is internally consistent?
- Aurornis 10mo ago> But an LLM can create a fully formed counterfactual universe This is a little too far into the woo side of LLM interpretations. The LLM isn’t forming a universe internally. It’s stringing tokens together in a way that is consistent with language and something that looks coherent. It doesn’t hold opinions or have ideas about the universe that it has created from some first principles. It’s just a big statistical probability machine that was trained on the inputs we gave it.