3 ms·
Interesting, so the LLM is "just" getting your question plus a normal text description of the image (as vectors)?
by eternauta3k 4y ago
Interesting, so the LLM is "just" getting your question plus a normal text description of the image (as vectors)?
- thewarrior 4y agoAt a high level yes. More precisely - It gets the question After irs passed through a matrix that transforms the text description of the image so the LLM can “understand” it. It maps from the space of one ML model to the other.