26 ms·A LoC is ~7 tokens thanks to the new toktoken tokenization in GPT-4. 32k is ~4.5k LoCby MacsHeadroom 3y agoA LoC is ~7 tokens thanks to the new toktoken tokenization in GPT-4. 32k is ~4.5k LoC