3 ms·
It may be instructive to consider what exactly you mean by "correct unicode handling". What would you say is the length of the Thai word ปฏิบัติจริง ? What do
by raiph 11y ago
It may be instructive to consider what exactly you mean by "correct unicode handling".
What would you say is the length of the Thai word ปฏิบัติจริง ?
What does Python 3 think is the length? What does Perl 6 think is the length? Can you explain the difference? And what do you think are the practical implications for code in Python 3 vs Perl 6 as it relates to "correct unicode handling", shorter code, and robustness?
- agumonkey 11y agoI think he meant consistent more than correct. I've read that once decoded, the data will be stable, unlike python2 where transcoding (lossy one that is) may occur between different modules under your nose.
- raiph 11y agoRight. Aiui both Python 3 and Perl 6 allow correct handling of Unicode byte buffers and whole strings. Which will be great for applications that don't need to do anything at substring or character level. Afaict, in Python 3, code that does things at substring/character level to Thai, Chinese, etc. text will be: * buggy, even spuriously cutting characters in half if any string changes are made, if standard string/substring/character functions are used OR * verbose and messy, if the reqired-for-correctness grapheme handling is introduced
- peteretep 11y agoIf you're a Perl programmer in Thailand, drop me an email