I'm pretty sure there is a spellchecker ran before the tokenisation also it is often wrong with spelling stuff out like that, especially with rarer or more int

I'm pretty sure there is a spellchecker ran before the tokenisation also it is often wrong with spelling stuff out like that, especially with rarer or more interesting tokens