Multimodal models use embeddings as well, the difference there is that they've been trained to associate the same position in latent space to text and to the im

Multimodal models use embeddings as well, the difference there is that they've been trained to associate the same position in latent space to text and to the image that text describes, that way it can turn a textual response into an image and vice versa. A lot of models use CLIP, an embedding method from openAI.