2 ms·
What do the tokens for an image even look like? I understand that tokens for text are just fragments of text... but that obviously doesn't make sense for images
by IshKebab 3y ago
What do the tokens for an image even look like? I understand that tokens for text are just fragments of text... but that obviously doesn't make sense for images.
- bonoboTP 3y agoThe image is subdivided by a grid and the resulting patches are fed through a linear encoder to get the token embeddings.