3 ms·
Exactly, the traces lack semantics and shouldn't be anthropomorphized. (I'm one of the students in the lab that wrote this, but not one of the authors)
by x_flynn 1y ago
Exactly, the traces lack semantics and shouldn't be anthropomorphized. (I'm one of the students in the lab that wrote this, but not one of the authors)
- theptip 1y agoThanks! So, how does this impact Deliberative Alignment[1], where IIUC the intermediate tokens are assessed (eg for referencing the appropriate policy fragment)? Does you see your result as putting that paradigm in question, or does the explicit reasoning assessment perhaps ameliorate the issue? [1]: https://arxiv.org/html/2412.16339v2 https://arxiv.org/html/2412.16339v2