2 ms·
ChatGPT is always making things up. It is correct when the things it makes up come from fragments of training data which happened to be correct, and didn't get
by kazinator 4y ago
ChatGPT is always making things up. It is correct when the things it makes up come from fragments of training data which happened to be correct, and didn't get mangled in the transformation.
Just like when a diffusion model is "correct" when it creates a correct shadow or perspective, and "incorrect" when not. But both images are made up.
It's the same thing with statements. A statement can correspond to something in the world, and thus be true: like a correct shadow. Or not, like a bad shadow. But in both cases, it's just made-up drivel.
If it turns out that there is a teacup orbiting Jupiter, that doesn't mean that postulating its existence on a whim had been valid. Truth requires provenance, not only correspondence which can be coincidental.
- cultureswitch 4y agoSomething can be truthfully describing the world by chance. The statement would still be true. In fact every statement we make about the world we live in is like this.
- kazinator 4y agoThe original assertion of such a statement has no basis, and continues not to even when the statement is independently discovered to be true. No, not every statement we make about the world is a baseless assertion that is true by chance.