3 ms·
Yes, you want to be aware of what your function approximator is doing when it approximates something. Fortunately in the case of fiction, making stuff up is ki
by skybrian 6y ago
Yes, you want to be aware of what your function approximator is doing when it approximates something.
Fortunately in the case of fiction, making stuff up is kind of the point. A human coauthor participates in turning randomness into meaning. Compare with interpreting vague song lyrics.
The problems are in areas where it's important to tell the truth. In non-fiction, quoting people accurately is important, but GPT-3 will make up quotes and citations, as well as getting them correct sometimes too. (It might be interesting to see if there is training that would encourage it to always quote accurately.)
- jamesjyu 6y agoSourcing is definitely an issue. With GPT-3 there is no "source," as it is still essentially a bag of word vectors. I've also seen it take existing quotes and misattribute them to the wrong (but similar) person.
- visarga 6y agoNLP used to be based on bag of words. GPT-3 takes into consideration all interactions and the ordering, thus, not a simple bag of vectors. Quite the opposite, it's an implicit graph neural net.