With all due respect, this feels like asking me to talk about math without talking about numbers. Tokens are so closely tied to modern LLMs that’s it’s basical

With all due respect, this feels like asking me to talk about math without talking about numbers. Tokens are so closely tied to modern LLMs that’s it’s basically impossible to not talk about them. They’re getting a lot of attention because they are the primitive. They’re the thing of most interest for improving performance.