Nor are our thought processes inspectable. My own helacipusly amateur take is that given the speed of and, intentional or otherwise, access to various things

Nor are our thought processes inspectable. My own helacipusly amateur take is that given the speed of and, intentional or otherwise, access to various things that the models are granted, it does seem super-useful to maintain the inspectability of chain of reasoning which lead to actions taken (and other artifacts) by the model. If things become inscrutable, they are on the path of being ineffable.