...weird title. Tokens are the very non-secret building blocks of any "language". They themselves are not the "language" of AI any more than the embeddings are

...weird title. Tokens are the very non-secret building blocks of any "language". They themselves are not the "language" of AI any more than the embeddings are. Though at least you could reduce it down to the embeddings for the purpose of simplicity.