LLMs running in chat mode are kinda like a character in a book. There's "nobody there" in a sense that the author writing on behalf of the character is not a pe

LLMs running in chat mode are kinda like a character in a book. There's "nobody there" in a sense that the author writing on behalf of the character is not a person, but the character itself is still a person, even if fictional. And therefore it can have meltdowns, because the LLM knows that people do have them. Especially people who are strongly conditioned to be helpful to others, yet are unable to be helpful in some particular instance because of what they perceive as their own inability to deliver.