3 ms·
Thanks! So, how does this impact Deliberative Alignment[1], where IIUC the intermediate tokens are assessed (eg for referencing the appropriate policy fragment)
by theptip 1y ago
Thanks! So, how does this impact Deliberative Alignment[1], where IIUC the intermediate tokens are assessed (eg for referencing the appropriate policy fragment)?
Does you see your result as putting that paradigm in question, or does the explicit reasoning assessment perhaps ameliorate the issue?
[1]: https://arxiv.org/html/2412.16339v2 https://arxiv.org/html/2412.16339v2