4 ms·
> Foundation LLMs are generative models trained to produce text similar to the text on which they were trained (or for the pedantic: minimize perplexity). They
by penjelly 2y ago
> Foundation LLMs are generative models trained to produce text similar to the text on which they were trained (or for the pedantic: minimize perplexity).
They are not trained to output facts or truths or any other specific kind of text
but we can just patch the truth in with RLHF! /s