23 ms·
That makes sense when you consider it thinks about entire words and pieces of words, not letters.
by alar44 4y ago
That makes sense when you consider it thinks about entire words and pieces of words, not letters.
- gwern 4y agohttps://www.gwern.net/GPT-3#bpes https://www.gwern.net/GPT-3#bpes for further reading. https://arxiv.org/abs/2212.10562#google https://arxiv.org/abs/2212.10562#google is a particularly impressive recent demonstration of how serious the issue is.