2 ms·
"Since a bunch of media outlets have adopted GPT-powered writing tools, future tokens are presumably going to be far less valuable" As long as a human verified
by lukan 2y ago
"Since a bunch of media outlets have adopted GPT-powered writing tools, future tokens are presumably going to be far less valuable"
As long as a human verified the output, I think it is fine. Training on unverified data is bad.
- swiftcoder 2y agoYou are still looping your own models output into the training set regardless. Human verification may avoid outright errors creeping in, but it won't stop the model biasing it's own training set