4 ms·
Would be fun to see a breakdown of how some arithmetic prompts are tokenised, to help understand this. eg: is the number “1.23e+5” one token?
by diatone 4y ago
Would be fun to see a breakdown of how some arithmetic prompts are tokenised, to help understand this. eg: is the number “1.23e+5” one token?