3 ms·
Even at this scale the model's able to answer questions fairly impressively, but I created an image with some distinct shapes in different positions and it didn
by vagabund 4y ago
Even at this scale the model's able to answer questions fairly impressively, but I created an image with some distinct shapes in different positions and it didn't go well [0]. I think however they're doing the image encoding doesn't capture positional information which, to my mind, limits a lot of use cases.
[0] https://i.postimg.cc/GtrGs8mw/Screenshot-2023-03-28-at-5-19-55-PM.png https://i.postimg.cc/GtrGs8mw/Screenshot-2023-03-28-at-5-19-...
- famouswaffles 4y agoit's not the image embedding. It's the objective task. Image to text is simply not good enough. It's really lossy and the datasets are garbage so it's not very robust.