Well, it's certainly not the lowest level token - to the degree we can talk about tokens in our brains in the first place. We can talk and think about such thi

Well, it's certainly not the lowest level token - to the degree we can talk about tokens in our brains in the first place. We can talk and think about such things as the shape of the letters, which it would take a Herculean effort for GPT-like models to learn, since it gets letters in a form where that information has been stripped away.