5 ms·
ASCII is a subset of UTF-8. It’s time for all tools and paths to just assume UTF-8 encoding. Most tasks assuming ASCII work fine on UTF-8 too (eg sorting). We
by unilynx 4y ago
ASCII is a subset of UTF-8. It’s time for all tools and paths to just assume UTF-8 encoding.
Most tasks assuming ASCII work fine on UTF-8 too (eg sorting). We do need to get rid of those byte order marks though, it breaks eg concatenation
- mike_hock 4y ago> Most tasks assuming ASCII work fine on UTF-8 too (eg sorting). cliché < clichñ < clich́e NFC vs. NFD.
- yorwba 4y agob'cliche\xcc\x81' (cliché) < b'clichz' (clichz) < b'clich\xc3\xa9' (cliché) < b'clich\xc3\xb1' (clichñ) Combining marks like accents are placed after the base character.
- mike_hock 4y agoYou're right. Sorry, I get confused by Qt's multi-decade old bug that they're not only refusing to fix but keep porting to new major versions. I bet they have unit tests asserting that the bug is still present.
- deleted 4y ago[deleted]
- rjh29 4y agoSort orders are different per locale. For example German and Swedish both have ä and ö but sort them differently relative to the other letters.
- kzrdude 4y agoThe posix locale and us-english both have `B` and `a` but sort them differently. (Posix B < a, US-english a < B) :)