3 ms·
> Can you spot any difference between “blöb” and “blöb”? It's tricky to try to determine this because normalization can end up getting applied unexpectedly (fo
by re 3y ago
> Can you spot any difference between “blöb” and “blöb”?
It's tricky to try to determine this because normalization can end up getting applied unexpectedly (for instance, on Mac, Firefox appears to normalize copied text as NFC while Chrome does not), but by downloading the page with cURL and checking the raw bytes I can confirm that there is no difference between those two words :) Something in the author's editing or publishing pipeline is applying normalization and not giving her the end result that she was going for.
00009000: 0a3c 7020 6964 3d22 3066 3939 223e 4361 .<p id="0f99">Ca
00009010: 6e20 796f 7520 7370 6f74 2061 6e79 2064 n you spot any d
00009020: 6966 6665 7265 6e63 6520 6265 7477 6565 ifference betwee
00009030: 6e20 e280 9c62 6cc3 b662 e280 9d20 616e n ...bl..b... an
00009040: 6420 e280 9c62 6cc3 b662 e280 9d3f 3c2f d ...bl..b...?</
Let's see if I can get HN to preserve the different forms:
Composed: ü
Decomposed: ü
Edit: Looks like that worked!
- Eisenstein 3y agoPerhaps the author used the same character twice for effect, not suspecting someone would use curl to examine the raw bytes?
- mgaunard 3y agoI believe XML and HTML both require Unicode data to be in NFC.
- fanf2 3y agoI don’t think so? https://www.w3.org/TR/2008/REC-xml-20081126/#charsets https://www.w3.org/TR/2008/REC-xml-20081126/#charsets XML 1.1 says documents should be normalized but they are still well-formed even if not normalized https://www.w3.org/TR/2006/REC-xml11-20060816/#sec-normalization-checking https://www.w3.org/TR/2006/REC-xml11-20060816/#sec-normaliza... But you should not use XML 1.1 https://www.ibiblio.org/xml/books/effectivexml/chapters/03.html https://www.ibiblio.org/xml/books/effectivexml/chapters/03.h...
- layer8 3y agoYou believe incorrectly. Not even Canonical XML requires normalization: https://www.w3.org/TR/xml-c14n/#NoCharModelNorm https://www.w3.org/TR/xml-c14n/#NoCharModelNorm
- mbrubeck 3y agoHTML does not require NFC (or any other specific normalization form): https://www.w3.org/International/questions/qa-html-css-normalization https://www.w3.org/International/questions/qa-html-css-norma... Neither does XML (though it XML 1.0 recommends that element names SHOULD be in NFC and XML 1.1 recommends that documents SHOULD be fully normalized): https://www.w3.org/TR/2008/REC-xml-20081126/#sec-suggested-names https://www.w3.org/TR/2008/REC-xml-20081126/#sec-suggested-n... https://www.w3.org/TR/xml11/#sec-normalization-checking https://www.w3.org/TR/xml11/#sec-normalization-checking