2 ms·
LLMs already do this in their own way. It's not like they learn to predict through magic osmosis. They make predictions and depending on how right or wrong they
by famouswaffles 3y ago
LLMs already do this in their own way. It's not like they learn to predict through magic osmosis. They make predictions and depending on how right or wrong they are, their neurons are shifted by grad descent to accommodate this error. Then they predict again.
The Text is the environment, The Text is the world and they are very much interacting with it.
- bwv848 3y agoNot really, LLM Decoders(without RLHF) are usually trained by teacher forcing, that means they just get learning singals from just predicting one token.