>>> when is it useful, if ever, to tokenize the whole input beforehand >> never > nope you are wrong. I never tokenise everything up front Explain how you co

>>> when is it useful, if ever, to tokenize the whole input beforehand >> never > nope you are wrong. I never tokenise everything up front Explain how you could possibly arrive at the complete opposite meaning of what I wrote when you even use the same word "never" as I did? Quick, get another downvote in, that'll teach me! Peak HN moment here.