There are pathologies where a person has no overt knowledge of something, and yet will act appropriately for someone who does have that knowledge - blindsight i

There are pathologies where a person has no overt knowledge of something, and yet will act appropriately for someone who does have that knowledge - blindsight is an example. Whether it is just a coincidence that you seem to have caught ChatGPT doing something that seems similar, I can't say.