4 ms·
> To oversimplify a bit, it's a next-word-in-the-sentence prediction engine. Turns out that when you ask LLMs to predict the next word in the sentence, and the
by cjbprime 3y ago
> To oversimplify a bit, it's a next-word-in-the-sentence prediction engine.
Turns out that when you ask LLMs to predict the next word in the sentence, and then train billions of parameters on billions of sentences, they realize the best way to improve at predicting the next word is to understand why the world works the way it does.