> The very architecture of the system guarantees it to produce new information derived from the training data rather than the training data itself A “classical

> The very architecture of the system guarantees it to produce new information derived from the training data rather than the training data itself A “classical” classifier can regurgitate its training data as well. It’s just that Reddit never seemed to care about people training e.g. sentiment classifiers on their data before. In fact a “decoder” is simply autoregressive token classification.