3 ms·
It's not taking into account UTF-8 though so maybe double or triple.
It's not taking into account UTF-8 though so maybe double or triple.
You could probably do this with minimal overhead by organizing the words by language assuming a codepage for each set.
Encoding schemes like UTF-8 don’t affect compressed size much. What matters is the quantity of information.