3 ms·
> Most of those people are doing it intentionally though - e.g. politicians when you ask them a question they don't want to answer. That's distinct from the fa
by TeMPOraL 3y ago
> Most of those people are doing it intentionally though - e.g. politicians when you ask them a question they don't want to answer.
That's distinct from the failure of communication. I believe GP meant something closer to what we'd call a "brain fart", where you read the text correctly, but "understood" something different.
> I don't think children have problems telling the difference between fantasy and reality. If a child isn't telling the truth, most of the time it's not because they can't tell the difference between truth and falsehood
Do you have children? I've been saying that GPT-3.5 and GPT-4 failure modes are disturbingly similar to the failure modes of my own kid, who happens to be 4.5 right now. I mean it.
It's a realization that hit me when I started noticing her "context window" growing - when she'd go into story mode, telling some fantasy stuff like having a sister giraffe who flies a helicopter or whatnot, I could tell that, if she doesn't mention something again within 30 seconds, it would never be mentioned again - a forgotten detail. That window of time kept growing over subsequent months, and is too large to notice now, but hey, the entire way she'd construct her stories was very similar to what you get when you prompt the LLM for a story and just let it keep writing.
Anyway, on the parenting stuff:
> it's not because they can't tell the difference between truth and falsehood, but because they are deliberately lying to you for one reason or another - e.g. they don't want to get punished.
That's true at a later age. Early on, even at 3 y.o., they get genuinely confused about reality.
- vidarh 3y ago> That's distinct from the failure of communication. I believe GP meant something closer to what we'd call a "brain fart", where you read the text correctly, but "understood" something different. That would be one example, yes. But we also often interpret a question in the context of the person asking to mean something different than what the question actually says. A concrete example of a simple question that people will often outright hesitate to answer directly is "do you want a fair society?" Almost everyone can answer that just "yes" if they interpret the question as genuinely meaning just what it objectively said. But what people subjectively interpret that question to mean tends to vary based on assumptions about how the political views of the person asking match your own and their intention for asking.