> Can anyone else verify if a LLM trained on a set of mostly-true info like Wikipedia will still make shit up? It will, but less frequently. For instance, I ca

> Can anyone else verify if a LLM trained on a set of mostly-true info like Wikipedia will still make shit up? It will, but less frequently. For instance, I can imagine a situation where it would give a plausibly sounding answer to a question based on an incorrect premise. The issue is that the bullshit responses will sound plausible from the stylistic pov. Under the hood LLMs we're talking about here are still just "spicy autocomplete" with non-deterministic results. The results are impressive, just not in the way the VC driven discourse/hype would suggest.