Every token emitted is a full-pass through the network, with the prompts and previous tokens (sent by you and the AI) given as input. And I agree that there is

Every token emitted is a full-pass through the network, with the prompts and previous tokens (sent by you and the AI) given as input. And I agree that there is certainly a capacity for reasoning, no matter how flawed it is. There is plenty of evidence of AI solving novel problems 0-shot. Maybe not 100% of the time, but even if you have to run it 100 times and it gets it right 75% of the time in pure reasoning problems, it's doing better than randomness.