3 ms·cl100k_base is a new tokenizer that is apparently being used in their new Embeddings project.by minimaxir 4y agocl100k_base is a new tokenizer that is apparently being used in their new Embeddings project.