2 ms·
I noticed that the Java @tokens definition doesn’t seem to support Unicode Java identifiers and Unicode escapes. Since the latter can appear anywhere in Java so
by layer8 5y ago
I noticed that the Java @tokens definition doesn’t seem to support Unicode Java identifiers and Unicode escapes. Since the latter can appear anywhere in Java source code [0], it’s likely impossible to have a fully compliant auto-generated Java lexer/parser from that tool.
[0] https://javajee.com/unicode-escapes-in-java https://javajee.com/unicode-escapes-in-java