4 ms·
Unfortunately, your "text safe" definition appears to exclude text in languages such as Persian (among others), where Zero Width Non-Joiner is required to write
by jfk13 4y ago
Unfortunately, your "text safe" definition appears to exclude text in languages such as Persian (among others), where Zero Width Non-Joiner is required to write some words correctly.
- kstenerud 4y agoOh damn good catch! Adding category Cf.
- jfk13 4y agoThanks.... though note that Cf also includes things like the bidi directional-override code points, which you might still prefer to exclude.
- kstenerud 4y agoYup, I've removed a bunch of Cf codes (it really is a grab bag!), but I'm not sure if removing BIDI could be done without breaking some languages? https://github.com/kstenerud/concise-encoding/blob/master/ce-structure.md#character-safety https://github.com/kstenerud/concise-encoding/blob/master/ce...