3 ms·
Hmm. Does HN use MySQL with "utf8" encoding as backend storage? ;)
by simoncion 11y ago
Hmm. Does HN use MySQL with "utf8" encoding as backend storage? ;)
- masklinn 11y agoIf that were the case, astral characters would be removed (e.g. shavian or the emoji block) but BMP symbols like U+263F MERCURY or U+262C ADI SHAKTI would be left alone, and they're not: "", "" Since U+A420 YI SYLLABLE JJUOX goes through (ꐠ) HN likely explicitly strips most symbols (but not all, U+00B6 PILCROW SIGN (¶) is unmolested)
- riffraff 11y agofor those not getting the joke: mysql has a thing called "utf8" which is not in fact utf8 and will (depending on settings) either truncate text when it meets a 4+ byte character, or raise an error. It also supports real utf8 in more recent versions calling it "utf8mb4"
- simoncion 11y agoEverywhere I've used mysql, the default has been to silently truncate data that doesn't fit in the "utf8" encoding! :(
- david-given 11y agoThis made filing a bug about Thunderbird not sizing astral plane code points correctly slightly more hilarious than it should have been (Mozilla's Bugzilla instance runs on MySQL)...