3 ms·
Running it through https://platform.openai.com/tokenizer https://platform.openai.com/tokenizer "mySuperLongVariableName" takes 5 tokens. "a", takes 1. mediumvar
by fragmede 8mo ago
Running it through https://platform.openai.com/tokenizer https://platform.openai.com/tokenizer "mySuperLongVariableName" takes 5 tokens. "a", takes 1. mediumvarname is 3 though. "though" is 1.