4 ms·

> If you trained GPT specifically on arithmetic tasks Sure but you'd have a lot of overlapping tokens with BPE, which doesn't help with convergence. GP is clai

by f_devd 4y ago

> If you trained GPT specifically on arithmetic tasks Sure but you'd have a lot of overlapping tokens with BPE, which doesn't help with convergence. GP is claiming it's specifically worse at arithmetic because of BPE which is true.