3 ms·

> UTF-8 strings can be compared with strcmp() No, they can't? These two UTF-8 byte sequences in a C char pointer, c3 a9 00 65 cc 81 00 Represent the same

> UTF-8 strings can be compared with strcmp() No, they can't? These two UTF-8 byte sequences in a C char pointer, c3 a9 00 65 cc 81 00 Represent the same string, but do not compare equal with strcmp. And it's not just that; you've noted how strtok will break down. strchr() can't be used w/ a non-ASCII needle, there is no support for code units, etc.

drran 6y ago
These two strings will be equal after normalization and validation of UTF-8.
flohofwoe 6y ago
That's a problem with the UNICODE standardization process, and not a problem with the UTF-8 encoding though.