4 ms·

I'm so excited for when their 70B version comes out! I'm wondering how much of a factor the larger token dictionary plays in this progress. Seems like greater

I'm so excited for when their 70B version comes out! I'm wondering how much of a factor the larger token dictionary plays in this progress. Seems like greater token lexicon translates to better learning. What do you think?

ganzuul 3y ago
Seems to functionally be the same as vocabulary, but optimized for language without e.g. onomatopoeia.