4 ms·
No way is vocab size zipfian. Word counts from a corpus follow zipf's law, but not vocab sizes themselves. Otherwise the most common vocab size would be equal
by soVeryTired 4mo ago
No way is vocab size zipfian. Word counts from a corpus follow zipf's law, but not vocab sizes themselves.
Otherwise the most common vocab size would be equal to one.