3 ms·
I really wonder if it is the case that the image processing is simply more tokens appended to the sequence. Would make the most sense from an architecture persp
by jerpint 3y ago
I really wonder if it is the case that the image processing is simply more tokens appended to the sequence. Would make the most sense from an architecture perspective, training must be a whole other ballgame of alchemy though
- benob 3y agoProbably. Check the kosmos-1 paper from Microsoft that appeared a few days before GPT4 was released: https://arxiv.org/abs/2302.14045 https://arxiv.org/abs/2302.14045