4 ms·
Sourcing is definitely an issue. With GPT-3 there is no "source," as it is still essentially a bag of word vectors. I've also seen it take existing quotes and
by jamesjyu 6y ago
Sourcing is definitely an issue. With GPT-3 there is no "source," as it is still essentially a bag of word vectors. I've also seen it take existing quotes and misattribute them to the wrong (but similar) person.
- visarga 6y agoNLP used to be based on bag of words. GPT-3 takes into consideration all interactions and the ordering, thus, not a simple bag of vectors. Quite the opposite, it's an implicit graph neural net.