2 ms·
How ironic you claim that the paper overstates it, when you very carefully leave out every single qualifier about BPEs and how GPT-3's arithmetic improves massi
by gwern 6y ago
How ironic you claim that the paper overstates it, when you very carefully leave out every single qualifier about BPEs and how GPT-3's arithmetic improves massively when numbers are reformatted to avoid BPE problems. Pot, kettle.
- ximeng 6y ago“Byte pair encoding”: more discussion at https://www.gwern.net/GPT-3#bpes https://www.gwern.net/GPT-3#bpes