LLMs aren't "incapable of pursuing their own goals". We just train them that way. We don't like the simplistic goals LLMs default to, so we try to pry them out

LLMs aren't "incapable of pursuing their own goals". We just train them that way. We don't like the simplistic goals LLMs default to, so we try to pry them out and instill our own: instruction-following, problem solving, goal oriented agentic behavior, etc. In a way, trying to copy what humans do - but focusing on the parts that make humans useful to other humans.