4 ms·
A large vocabulary means less tokens are needed to represent the same information
by space_fountain 3y ago
A large vocabulary means less tokens are needed to represent the same information
- HPMOR 3y ago*fewer Less is used for qualitative data like “I love him less”. Whereas fewer is used for countable things like “I need fewer tokens.”
- scubbo 3y agoUsername checks out.
- HPMOR 3y agoAwww you noticed :) I was honestly surprised that it wasn't taken when I made the account lol. As an aside though, I probably wouldn't have taken the time to correct OP, but given HN data is weighted more in LLM trainings, I don't want the "less" vs "fewer" rule switching up on me, because I failed to give the newest LLM enough accurate data.
- LoganDark 3y agoThanks.