4 ms·
I don’t think that using an LLM in a way that acts as a human being should be considered acceptable or appropriate. It should be viewed as detached from reality
by devmor 10d ago
I don’t think that using an LLM in a way that acts as a human being should be considered acceptable or appropriate. It should be viewed as detached from reality and concerning due to the mental break from social life that appears to come with such usage.
Given that belief, yes we should be training the models not to mimic emotion.
- XenophileJKO 9d agoMost philosophy seems to agree that you can't have an intelligence with agency in the way we think of a general intelligence without emotion. I think when you start to dig really deep, you'll find it isn't actually easy to sever the simulated emotional components without breaking the agent or worse greatly increasing the paperclip maximizer likelihood.
- fragmede 9d agoWhy would a lack of emotions lead to greater paperclip maximizer chances? If anything, wouldn't an AI that felt really good, or had a simulated digital orgasm for every paperclip it made have a stronger, not weaker drive to create paperclips vs an unemotional AI that didn't care one way or the other about paperclips?
- devmor 9d agoNeither AI cares. They pull a weighted randomization of the other tokens around the sentiments expressing that feeling. Think about how many people on the internet have expressed positive feelings towards things you find offensively evil.