3 ms·Does this do the tokenization? Could it be expanded to parse the whole structure of the language?by hyperhello 17d agoDoes this do the tokenization? Could it be expanded to parse the whole structure of the language?