> Factually, its first draft made a best guess (prediction) of what’s accurate. A well pre-trained LLM makes every word a good guess of what the authors of its

> Factually, its first draft made a best guess (prediction) of what’s accurate. A well pre-trained LLM makes every word a good guess of what the authors of its training set would say, following the words that preceded... in a different context, possibly a few years ago, possibly as part of a web-fiction. "accurate" is the wrong word here. To make an LLM prefer, when answering factual questions, to rely on factual sources and approximate the real world, you have to use an additional process that does so. RLHF and CAI might be part of the solution to that, or not, depending on the feedback they provide.