3 ms·
> It's about precision. This is utterly wrong. There is a huge amount of redundancy in images compared to language. This redundancy is why image models have
by ipunchghosts 4y ago
> It's about precision.
This is utterly wrong. There is a huge amount of redundancy in images compared to language. This redundancy is why image models have yet to surpass language models. In some sense, language is much easier than the vision problem.
- hgsgm 4y agohow do you measure "surpass"?
- dragonwriter 4y agoI think no one has bothered with using as many images as documents used to train GPT-3.5, to create as big of a model, and then RLHF as done to produce ChatGPT from GPT-3.5 is why image models haven’t surpassed language models. At any level of scale of model and scale of training set, images models do surpass language models.
- ipunchghosts 4y agoNo way this is true. I have yet to see it. Image permutations are so easy to come by where as they are eventually infinite.