4 ms·
When I read the output of this model I'm really quite impressed. However, given the sheer size of it and huge training corpus, to what extent is it just regurgi
by losvedir 6y ago
When I read the output of this model I'm really quite impressed. However, given the sheer size of it and huge training corpus, to what extent is it just regurgitating source text?
- justanotherhn 6y agoI guess we could ask the same question about ourselves. How much of what we say is just a regurgitation of what we hear/read every day?
- the8472 6y agoThis is a common question and the authors answer this in their paper by checking the training set when evaluating it on particular tasks. E.g. for the addition task they search for existing samples of addition in the training data and find that not all are represented.