3 ms·

When UTF-8 wasn't univeral (geez, I'm old... It was still this century though!), a page I found to figure out what was going on when I encountered Mojibake is:

When UTF-8 wasn't univeral (geez, I'm old... It was still this century though!), a page I found to figure out what was going on when I encountered Mojibake is: http://www.jeppesn.dk/utf-8.html http://www.jeppesn.dk/utf-8.html . Amazingly it hasn't suffered linkrot and is still online. And I fully agree with footnote 2, why is an extended Unicode character being used in place of the apostrophe? https://tedclancy.wordpress.com/2015/06/03/which-unicode-character-should-represent-the-english-apostrophe-and-why-the-unicode-committee-is-very-wrong/ https://tedclancy.wordpress.com/2015/06/03/which-unicode-cha...

LegionMammal978 2y ago
Because the apostrophe as used in English is a punctuation mark, not a letter, and especially not a modifier letter. The author argues that any name ought to be matched by anything in \w, and we should avoid a punctuation character for that reason, but he doesn't mention other punctuation marks like the hyphen that also commonly occur in names.
throw0101b 2y ago
> And I fully agree with footnote 2, why is an extended Unicode character being used in place of the apostrophe? Some reasons: > The Unicode character ’ (U+2019 right single quotation mark) is used for both a typographic apostrophe and a single right (closing) quotation mark.[1] This is due to the many fonts and character sets (such as CP1252) that unified the characters into a single code point, and the difficulty of software distinguishing which character is intended by a user's typing.[2] There are arguments that the typographic apostrophe should be a different code point, U+02BC modifier letter apostrophe.[3][better source needed] > The straight apostrophe ' (the "ASCII apostrophe", U+0027 ' apostrophe) is even more ambiguous, as it could also be intended as a left or right quotation mark, or a prime symbol. * https://en.wikipedia.org/wiki/Right_single_quotation_mark https://en.wikipedia.org/wiki/Right_single_quotation_mark * https://en.wikipedia.org/wiki/Apostrophe#Unicode https://en.wikipedia.org/wiki/Apostrophe#Unicode

LegionMammal978 2y ago

Because the apostrophe as used in English is a punctuation mark, not a letter, and especially not a modifier letter. The author argues that any name ought to be matched by anything in \w, and we should avoid a punctuation character for that reason, but he doesn't mention other punctuation marks like the hyphen that also commonly occur in names.

throw0101b 2y ago

> And I fully agree with footnote 2, why is an extended Unicode character being used in place of the apostrophe? Some reasons: > The Unicode character ’ (U+2019 right single quotation mark) is used for both a typographic apostrophe and a single right (closing) quotation mark.[1] This is due to the many fonts and character sets (such as CP1252) that unified the characters into a single code point, and the difficulty of software distinguishing which character is intended by a user's typing.[2] There are arguments that the typographic apostrophe should be a different code point, U+02BC modifier letter apostrophe.[3][better source needed] > The straight apostrophe ' (the "ASCII apostrophe", U+0027 ' apostrophe) is even more ambiguous, as it could also be intended as a left or right quotation mark, or a prime symbol. * https://en.wikipedia.org/wiki/Right_single_quotation_mark https://en.wikipedia.org/wiki/Right_single_quotation_mark * https://en.wikipedia.org/wiki/Apostrophe#Unicode https://en.wikipedia.org/wiki/Apostrophe#Unicode