4 ms·
Amazing! I had just written a regex tokenizer in python the other day, this would have been great!
by anitil 3y ago
Amazing! I had just written a regex tokenizer in python the other day, this would have been great!
- cricalix 3y agoCurious cat - had you considered using Antlr4 and a Python visitor/listener? (Were you aware of antlr?). Depending what you're trying to do with a regex tokenizer, it might be suitable.
- anitil 3y agoIt was more just for fun than anything else. I was more interested in the recursive descent parser so the tokenizer was just a step along the way. I've played with Antlr but never really vibed with it to be honest (and it was years ago)