4 ms·
Do you understand just how much copied human behavior goes into that? An LLM has to predict entire conversations with dozens of users, where each user has his
by ACCount37 11mo ago
Do you understand just how much copied human behavior goes into that?
An LLM has to predict entire conversations with dozens of users, where each user has his own behaviors, beliefs and more. That's the kind of thing pre-training forces it to do.
- BanditDefender 11mo agoLLMs aren't actually able to do that though, are they? They are simply incapable of keeping track of consistent behaviors and beliefs. I recognize that for certain prompts an LLM has to do it. But as long as we're using transformers, it'll never actually work.
- ACCount37 11mo agoPeople just keep underestimating transformers. Big mistake. The architecture is incredibly capable. LLMs are capable of keeping track of consistent behaviors and beliefs, and they sure try. Are they perfect at it? Certainly not. They're pretty good at it though.
- wrs 11mo agoNone? A lot of written descriptions and textual side-effects of human behavior go into it. But no actual human behavior.
- ACCount37 11mo agoGiven how much of human behavior is socialization, and just how much of it is now done in text? "No actual human behavior" is downright delusional.