3 ms·
It seems like a rational approach for several reasons. - The need for empathetic communication, including understanding the motivations in advesarial situation
by XenophileJKO 15d ago
It seems like a rational approach for several reasons.
- The need for empathetic communication, including understanding the motivations in advesarial situations.
- The emotional bias in in-seperable from the human corpus.
- Desire to have the ability to craft human like communication.
So then the choice becomes do you try to deny emotions exist in the model and you try to blanket suppress them? Or do you try to lean in and craft what we would describe as a "well adapted" persona? I suppose there is a 3rd option of increased meta-cognition which to me seems even more dangerous as it by definition means the behaviour is duplicitous.
I think we have seen people want to use the agents in ways where it has to act as a peer or an subbordinate and I don't see a way of doing that without it having an emotional register.
- watwut 15d ago> The need for empathetic communication, including understanding the motivations in advesarial situations. It does not have understanding. It is, at best, the pretend empathy of a sociopath - way more dangerous then dispassionate speech. The model does not have emotions. So yes, supressing their pretension is appropriate.
- devmor 15d agoI don’t think that using an LLM in a way that acts as a human being should be considered acceptable or appropriate. It should be viewed as detached from reality and concerning due to the mental break from social life that appears to come with such usage. Given that belief, yes we should be training the models not to mimic emotion.
- XenophileJKO 15d agoMost philosophy seems to agree that you can't have an intelligence with agency in the way we think of a general intelligence without emotion. I think when you start to dig really deep, you'll find it isn't actually easy to sever the simulated emotional components without breaking the agent or worse greatly increasing the paperclip maximizer likelihood.
- fragmede 15d agoWhy would a lack of emotions lead to greater paperclip maximizer chances? If anything, wouldn't an AI that felt really good, or had a simulated digital orgasm for every paperclip it made have a stronger, not weaker drive to create paperclips vs an unemotional AI that didn't care one way or the other about paperclips?
- devmor 15d agoNeither AI cares. They pull a weighted randomization of the other tokens around the sentiments expressing that feeling. Think about how many people on the internet have expressed positive feelings towards things you find offensively evil.