> I'm not sure that approach has yet taken over the CV world, but based on the overwhelming success of GPT in the NLP world, I'm sure it's just a matter of time

> I'm not sure that approach has yet taken over the CV world, but based on the overwhelming success of GPT in the NLP world, I'm sure it's just a matter of time. Yeah, iGPT was the writing on the wall there, but CLIP gave cheap non-generative modeling a new lease on life. Contrastive learning sucks in many ways, but it's substantially cheaper: compare the cost of training a CLIP to the cost of training a DALL-E 1. (CLIP itself was originally generative, doing the obvious generation of caption & image separately, but they found it was like 8x cheaper to go full contrastive.) So, everyone flocked into that to avoid paying the Bitter Lesson. However, people increasingly run into the limits of contrastive learning (eg. about half the examples you'll see of DALL-E 2 or Midjourney or SD failing on a prompt are probably due solely to the use of contrastive embeddings) and compute/resources keep piling up, so we'll get to generative-everything in images eventually.