The scanner can probably be zero allocation though - zig should be able to express an iterator over the input byte array that returns a token on dereference wit

The scanner can probably be zero allocation though - zig should be able to express an iterator over the input byte array that returns a token on dereference without needing more state than the position in the array