4 ms·
Huh? The images are tokenized in the same way language is and it’s just fed into one single model. Not multiple smaller expert models. Image gets rasterized in
by stingraycharles 5mo ago
Huh? The images are tokenized in the same way language is and it’s just fed into one single model. Not multiple smaller expert models.
Image gets rasterized into smaller pieces (eg 4x4 pixels) and each of those is assigned a token, similarly how text is broken up into tokens. And the whole thing is fed into a single model.
- FeepingCreature 5mo agoYes I'm saying > Imagine face recognition to work like a text chat, where the PC gets the frame from the camera and writes in the chat: "Who's that? Here's the RGB888 image in hex: ...". that's p much how it works.
- stingraycharles 5mo agoBut that isn’t a specialized model like the grandparent claimed, but rather a single, multi-modal model.
- Dylan16807 5mo agoYes, the "imagine" was showcasing the opposite of a specialized model to call it a bad idea.