4 ms·
The LLM doesn't hold the whole dataset in its head either.
by jackmott42 3y ago
The LLM doesn't hold the whole dataset in its head either.
- aezart 3y agoNot for a lack of trying. If you give it a small enough training set or a big enough neural network, it will directly memorize the whole thing. You have to intentionally make its brain too small to do that in order to force it to find patterns in the data instead.