16 ms·
It's not. It's basically the same model as GPT-3 (though smaller), and generally speaking the vast majority of its outputs should not be anything in its trainin
by moyix 5y ago
It's not. It's basically the same model as GPT-3 (though smaller), and generally speaking the vast majority of its outputs should not be anything in its training set. The big exception is code that showed up many times in the training data (like the famous inverse square root function).