3 ms·
How sure are you that humans don’t also “simply produce plausible-sounding text”? I’m watching my toddler learning to speak and it’s remarkably like an early L
by jiggawatts 2y ago
How sure are you that humans don’t also “simply produce plausible-sounding text”?
I’m watching my toddler learning to speak and it’s remarkably like an early LLM that outputs gibberish with nuggets of sense.
Conversely I’ve seen middle-aged professionals write formal design documents that are markedly inferior to what GPT-4 can produce. This is at every level: overall structure, semantics, and syntax. Diagrams with arrows the wrong way, labels with typos, labels on the wrong object, mixed up icons, tables with made-up content, and on and on.
Aren’t we all doing this to some degree? Half way through a sentence do you known ahead of time exactly what you’re about to say three pages later? Or are you just “completing” the next word based on the context?
- lolinder 2y ago> How sure are you that humans don’t also “simply produce plausible-sounding text”? I'm not, and I didn't say I was. Nothing in my comment is downplaying the success and utility of LLMs. Nothing in my comment is suggesting that they won't get better or even that they won't get better than us humans. It is strictly an observation that these two things that we call different names—hallucinations and alignment—are actually equivalent and can each be expressed in terms of the other. A hallucination is a specific kind of misalignment, nothing more.