I am recommending that you add more context to your question since it has been posted a couple times but has had zero engagement. HN is not an AIML discussion

I am recommending that you add more context to your question since it has been posted a couple times but has had zero engagement. HN is not an AIML discussion forum. Putting 10% more work in the question could yield 400% better responses. Linking to what BLIP2 is a good start https://huggingface.co/docs/transformers/main/en/model_doc/blip-2 https://huggingface.co/docs/transformers/main/en/model_doc/b... https://github.com/salesforce/LAVIS https://github.com/salesforce/LAVIS