2 ms·
So it is only about 256 tokens per image. I think the standard text tokenization method encodes two bytes per token, resulting in around 65.000 different tokens
by cubefox 3y ago
So it is only about 256 tokens per image. I think the standard text tokenization method encodes two bytes per token, resulting in around 65.000 different tokens. If the same holds for images, given that they have the same price in the API, that would be just 512 bytes per image. Which seems impossibly low considering that the AI is still able to read those book titles. I don't understand what is going on here.