2 ms·
What do image tokens look like? Groups of pixels?
by flangola7 4y ago
What do image tokens look like? Groups of pixels?
- jjoonathan 4y agoThe ViT paper has the details: project 16x16 groups of pixels through a learned embedding, combine with positional encoding, and feed to an attention layer. It's delightful that this is practically identical to the NLP architecture with only the tiniest adaptive tweak!