So for example if it responded with something like this to me, I would point out Clever Hans the trick horse that answered math questions was giving the specifi

So for example if it responded with something like this to me, I would point out Clever Hans the trick horse that answered math questions was giving the specific answer the trainer provided, but an LLM is yielding well-structured content it was trained on that me the prompter is trying to get out that I haven’t seen before. I know what it does not look like and I know pieces of what it does. So no not the same. Then the LLM would take this and redo its answer. Unlike internet strangers, who usually respond unhelpfully to adversarial exchanges because they tend to be too fixated, for my purposes, on finding ways to make their original answer right.