5 ms·
Here's a good starting point if you want to know more about this topic: https://arxiv.org/abs/2103.00020 https://arxiv.org/abs/2103.00020
by kadushka 2y ago
Here's a good starting point if you want to know more about this topic: https://arxiv.org/abs/2103.00020 https://arxiv.org/abs/2103.00020
- prats226 2y agoThis is CLIP. Here if you would see, the model is pretrained to ingest both images and text. However if you would see the prediction mode, its basically text generation only. None of the multi-modal architectures think of both image and text as first class citizens