3 ms·You can also tell LLMs not to tokenise, convert text to embeddings to guess the next token. /sby Oras 2y agoYou can also tell LLMs not to tokenise, convert text to embeddings to guess the next token. /s