4 ms·
> LLMs do now have a concept of truth now since much of the RLHF is focused on making them more accurate and true. Is it? I thought RLHF was mostly focused on
by kaoD 2y ago
> LLMs do now have a concept of truth now since much of the RLHF is focused on making them more accurate and true.
Is it? I thought RLHF was mostly focused on making them (1) generate text that looks like a conversation/chat/assistant (2) ensure alignment i.e. censor it (3) make them profusely apologize to set up a facade that makes them look like they care at all.
I don't think one can RLHF the truth because there's no concept of truth/falsehood anywhere in the process.