3 ms·The llm has absolutely no way of knowing which characters are in which token.by fzzzy 2y agoThe llm has absolutely no way of knowing which characters are in which token.