4 ms·
Have you ever written your own unicode library, or are you just parroting what you've heard? I have written my own unicode library, normalizing strings as UTF-
by bumblebritches5 8y ago
Have you ever written your own unicode library, or are you just parroting what you've heard?
I have written my own unicode library, normalizing strings as UTF-32 is MUCH MUCH MUCH easier than trying to do the same in UTF-8 or UTF-16.
not to mention casefolding, and it also allows you to design better interfaces, so that the actual algorithm only needs to be implemented once.
- greglindahl 8y agoSounds like your library is the poster-child for: > it blows up memory usage for ASCII and BMP (4 bytes per codepoint versus 1~3)
- bumblebritches5 8y agoFor the microseconds it's in the decoded state, sure, but I'm not dealing with massive strings. Literally all the strings I'm dealing with are under 256 codepoints.