Exactly. The article is kind of sneaking in the claim that the LLM ought to be ignoring the "irrelevant" facts about cats even though it is explicitly labelled

Exactly. The article is kind of sneaking in the claim that the LLM ought to be ignoring the "irrelevant" facts about cats even though it is explicitly labelled as interesting.