4 ms·
Yeah, Sean Barrett has a good writeup about them and optimizing them for branch-prediction, etc It's framed in the context of programming-language tokenization
by sebastianmestre 2y ago
Yeah, Sean Barrett has a good writeup about them and optimizing them for branch-prediction, etc
It's framed in the context of programming-language tokenization, but the principles are the same.
https://nothings.org/computer/lexing.html https://nothings.org/computer/lexing.html