3 ms·
NLP used to be based on bag of words. GPT-3 takes into consideration all interactions and the ordering, thus, not a simple bag of vectors. Quite the opposite, i
by visarga 6y ago
NLP used to be based on bag of words. GPT-3 takes into consideration all interactions and the ordering, thus, not a simple bag of vectors. Quite the opposite, it's an implicit graph neural net.