4 ms·
> demonstrate that the LLM will deny that they know fact X (or be flaky about it, randomly denying and divulging the fact) No, the sampling algorithm you used
by astrange 3y ago
> demonstrate that the LLM will deny that they know fact X (or be flaky about it, randomly denying and divulging the fact)
No, the sampling algorithm you used to query the LLM does that. Not the model itself.
e.g. https://arxiv.org/pdf/2306.03341.pdf https://arxiv.org/pdf/2306.03341.pdf
> B. They know they know fact X, but avoid acknowledging for ... reasons?
That reason being that the sampling algorithm didn't successfully sample the answer.