3 ms·
Would be interesting to see how changing the tokenization strategy — whole words or even phrases instead of traditional tokens — changes the results.
by kgc 3y ago
Would be interesting to see how changing the tokenization strategy — whole words or even phrases instead of traditional tokens — changes the results.