High-order thought can mean a bunch of things more generally, in this case I meant it to refer to thinking about thinking because "faking" alignment is (I asser

High-order thought can mean a bunch of things more generally, in this case I meant it to refer to thinking about thinking because "faking" alignment is (I assert) not scary without that. The reason why is: the core of the paper suggests that they trained a model and then fed it adversarial input, and it mostly (and selectively) kept to its training objectives. This is exactly what we'd expect and want. I think most people will hear that pretty much mostly not be alarmed at all, even lay people. It's only alarming if we say it is "faking" "alignment." So that's why I thought it would be helpful to scope the word in that way.