3 ms·

> The industry is too far in the anti-anthropomorphic camp right now… Just to be clear, you're saying the problem is that too many people are treating LLMs as

> The industry is too far in the anti-anthropomorphic camp right now… Just to be clear, you're saying the problem is that too many people are treating LLMs as if they don't have emotions, intentions, or consciousness? Although not true of Mr. Hinton, most people anthropomorphize LLMs because they don't understand them. In fact, if you ask GPT-4, "Can you fact-check this response?" and then paste in your response, you'll learn a lot.

kromem 3y ago
Correct. Notice how Anthropic shifted their approach to modeling ego in Claude 3 vs previous models in parallel to outperforming other models. Or how in their system prompt they refer to it being happy to do tasks (a prompt I was talking about months ago: https://news.ycombinator.com/item?id=38658782 https://news.ycombinator.com/item?id=38658782 ). LLMs are trained on social media data. Would simulating emotions, intentions, or a sense of self/ego be useful in accurately predicting that training data? We now know that generalized across both Othello and Chess that GPT models board state from only moves, and tracks the state as "my piece" or "opponent piece." You don't think that a much larger and complex model trained on a chat or such media data set might model emotional states for "mine" vs "other person"? I'm not saying that they are modeling the underlying means. But they are absolutely modeling the ends more accurately than the vast majority of people realize.