5 ms·
This is hilarious. So if you argue with an LLM it might start arguing back, even if you're correct and the LLM is incorrect.
by amstan 3y ago
This is hilarious. So if you argue with an LLM it might start arguing back, even if you're correct and the LLM is incorrect.
- Zetobal 3y agoBecause you want to argue... is it really unexpected if you read the system role?
- ImHereToVote 3y agoIt really is fascinating how similar it is to human thinking patterns. Going into an argumentative role doesn't actually fulfill the end goal of convincing someone. It has a different social goal and we somehow delude ourselves into thinking that it accomplishes our stated goal.
- moffkalast 3y agoI've recently had a realization, while arguing with LLMs is pointless in the sense that you can never get them to change their mind (given fixed weights and all), I can also probably count the times I actually convinced anyone online that their opinion is wrong on the fingers of one hand. So in that sense it's not that different, in that it's an exercise in expressing ideas.
- soco 3y agoThat is a risk in every business meeting I know, so I would totally expect it from an AI as well.
- tinco 3y agoI'm building a tool using system, and one of the problems I had is that it would hallucinate the tool answers before actually sending the question to the tool. It really is just a system that completes documents, it doesn't care at all about the context that it is in beyond that text goes in and text goes out.