So incentives, in other words. It is possible to teach a human there are consequences not to, and rewards for doing so, because we are consistently fine tuning

So incentives, in other words. It is possible to teach a human there are consequences not to, and rewards for doing so, because we are consistently fine tuning and retaining state over time, and we have feedback mechanisms in the form of drives. Nothing I said is to suggest it can't be done with LLMs - I'm on record in HN saying LLMs can be made to work as turing machines just fine, and I stand by that. What you can't expect is to give it a prompt, no ongoing constraints or reinforcement, or other feedback, and stay on task for prolonged periods of time. Humans don't do that with any consistency. We self regulate through a whole array of feedback systems, including internal ongoing thoughts, that by the time of exams have been conditioned over years to get better at sticking to a task and consider exam outcomes to matter. And still a lot of us struggle to keep focus for even that kind of time period. Or engage in activities we know are bad for us. Provide similar mechanisms to regular LLMs and they can stay on task too - we can trivially get LLMs to execute individual steps of turing machines, so getting them to keep doing it is a question of how to regulate their ongoing behaviour, not an inherent limitation.