3 ms·
If an LLM has memorized a book, doesn't that mean that too much computation was wasted on using backprop to get that data into the network? It should be learnin
by genxy 6mo ago
If an LLM has memorized a book, doesn't that mean that too much computation was wasted on using backprop to get that data into the network? It should be learning relationships, not memorizing swaths of text.