Subbarao Kambhampati and his team has several papers strongly suggesting that the intermediate tokens are of no symantic import.[0] My hunch is that training e

Subbarao Kambhampati and his team has several papers strongly suggesting that the intermediate tokens are of no symantic import.[0] My hunch is that training explicitly for human acceptance of the intermediate/scratch tokens will end up being expensive. What you need is to converge to the correct answer, and scratch space dramatically improves expressivity[1], but the relationship to learning and retrieval is still open unless I missed something. Remember even access to a pure random Oracle dramatically improves compute time on some problems. [0] https://arxiv.org/abs/2505.13775 https://arxiv.org/abs/2505.13775 [1] https://arxiv.org/abs/2502.02393 https://arxiv.org/abs/2502.02393