2 ms·> GPT-3 reportedly had only 50,257 The most common vocabulary size today is 32k.by qeternity 3y ago> GPT-3 reportedly had only 50,257 The most common vocabulary size today is 32k.