3 ms·
> How do LLMs do it? They don't learn by writing a lot they learn by reading a lot. Literally they learn by both, training process is filled with "exercises" f
by embedding-shape 5mo ago
> How do LLMs do it? They don't learn by writing a lot they learn by reading a lot.
Literally they learn by both, training process is filled with "exercises" for the weights to be shaped by, not just "seeing" tokens :) At least the typical LLM that outputs tokens have to actually "practice" doing so.
- galaxyLogic 5mo agoTrue. Just saying we learn not only by lots of trial and error, but also by trying to imitate others.