4 ms·
LLMs cannot write dialogue between two characters where one person knows a fact and the other person doesn't. It will consistently make the character who should
by rymiel 2mo ago
LLMs cannot write dialogue between two characters where one person knows a fact and the other person doesn't. It will consistently make the character who shouldn't know something bring up said fact and I have not found a model which will not do this. All these years of LLM research and it fails grade schooler level logic, if it is even slightly abstracted behind a story.
- BoredomIsFun 2mo agoA good plenty of counterexamples on eqbench.com.
- deleted 2mo ago[deleted]
- Cider9986 2mo ago[dead]
- idiotsecant 2mo agohttps://claude.ai/share/3cbfd4fe-a386-4528-94ba-238782b7e925 https://claude.ai/share/3cbfd4fe-a386-4528-94ba-238782b7e925 This seems easily falsifiable