3 ms·
> ...the main development is the rise of *multimodal learning*. > Multimodal learning, in this case, is learning to match up text and images. Our new models ar
by seanwilson 5y ago
> ...the main development is the rise of *multimodal learning*.
> Multimodal learning, in this case, is learning to match up text and images. Our new models are really good at learning to write captions for images, and (more importantly for artistic purposes) to generate images that correspond to a given caption.
Can anyone explain this more? I think I recall Facebook was automatically generating captions for images automatically a good while ago, but this is something different?
- scottmf 5y agohttps://openai.com/blog/clip/ https://openai.com/blog/clip/