4 ms·
That is true, but the benefits of UTF-32 is minor compared to UTF-8, and might not be worth the cost. And I say that as someone who is developing a language wh
by lokedhs 6y ago
That is true, but the benefits of UTF-32 is minor compared to UTF-8, and might not be worth the cost.
And I say that as someone who is developing a language which only has UTF-32 support.
The problem is that even with UTF-32, doing things like splitting strings is inherently unsafe, so you are still going to need a Unicode library to do proper splitting by grapheme cluster. In practice, almost all string splitting works on ASCII text, and assumes everything else is data that should not be manipulated. For this, UTF-8 is perfectly acceptable.