I know it's kind of anathema to how these tools work, but I'd love to know what caused it to respond like that. I wonder if it's possible that much like carbon

I know it's kind of anathema to how these tools work, but I'd love to know what caused it to respond like that. I wonder if it's possible that much like carbon dating we've now poisoned the well, you can't use trivial tests on AI that has been trained on data that mentions those types of tests. Sure, the first set of LLMs were impressive, but what if the result of those LLMs was an explosion in the discussion of how to evaluate LLMs and now we have a set of LLMs trained on.... how to test LLMs?